/ 



DOCUMENT BESUME 



ED 080 416 

AUTHOR 
TITLE 

INSTITUTION 

PUB DATE 
NOTE 

AVAILABLE FROM 



EDRS PRICE 
DESCRIPTORS 



S^O 



006 039 



And Others 



Semb, George, Ed. ; 
Behavior Analysis and Education. 
Kansas Univ., Lawrence* Dept. of Hiiman 
Development. - , 

72 * 

4<»2p. . . - 

Department of Human Development, University of 
Kansas, Lawrence, Kansas eeO^^-'CSr. 98) 

MF-$0.65 HC Not Available from EDRS.. 
♦Behavioral science Research; ♦Behavioral sciences; 
Behavior Patterns; Case Studies (Education); Child- 
Development; conference Reports; Educational 
Objectives; ♦Educational Programs; Educational 
strategies; Educaticmal Theories; Elementary Grades; 
Higher Education; Intermediate Grades; Secondary 
Grades; /State of the Art Reviews; Student Behavior; 
Teacher Education 



ABSTRACT 

This book presents part of the proceedings from the 
Third Annual conference on Behavior Analysis in Education which was 
designed to provide Project Follow Through with the most current 
research products in the field, and to serve participating 
researchers by providing a medium for exchange of information 
regarding the state of the art and its most immediate challenges. .Tti 
papers published . -e organized in ?even sections. Part I includes a 
discussion of some of- the current"problems confronting applied 
behavior analysis and suggestions of some alternate techniques 
behavior analysis might use to have a greater^ impact on education. 
Part II consists of seven papers which address themselves to 
relatively new areas of research. -Subsequent sections present a 
comprehensive behavior analysis program far handicapped children, 
description of the use of students as behaviora-1 engineers, 
consideration of teacher "training programs, current tecjuiiques and 
procedures. The concluding section emphasizes a behavioral approach 
to higher education* (Author/ SHM) 
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One indi vidual ,^more than any other, deserves special recognition for 
her outstanding services as typist, editor, English grammarian, proof- 
reader, artist and organtzer-^Cindy Stewart. With- almost a single- 
handed effort, Cindy has made this book possible. We f requentJy talk 
about errorless performance, but seldom do we encounter an- individual 
whose dedication to a^task produces it. Cindy Stewart is one of those 
rare people, and it was our fortune that she was responsible for the 
final preparation of this book* 

The co-editors of this book deserve special credit, too, for their 
long hours of editorial review, committee meetings and the conference 
'itself* We received over 120 manuscripts, each of which was reviewed 
, by at least two of the co-editors* Nearly every manuscript accepted 
for presentation at the conference underwent at least one revision* 
Those which are presented here have been further edited and revised. 
The cp-editors did an outstanding job to insure that the final prod- 
uct would be our best product* 

We are also indebted to Gene Ramp and Bill Hopkins, authors of the 
1971 proceedings, for their support and encouragement* Their exper- 
iences of a year ago enabled \is to avoid many of the problems they 
encountered. 

Finally, we would like to express our thanks to the many people who 
helped make- this conference a success because of their many, gener- 
ally unacknowledged contributions* These include those who helped 
transport visitors to and from the airport and campus, the many people 
around town who lent their rooms, yards, sufas and homes to stucents 
who attended the conference without financial support, members of the 
Follow Through staff who helped with innumerable tasks from audio- 
visual services to entertainment, the entire Department of Human De- 
velopment, and most importantly the conference participants who crit- 
ically but warmly helped us and each other* 
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The Third Annual Conference on Behavior Analysis in Education met on^ 
the Lawrence campus of the Uni vers i ty^of Kansas on May 10, 11 and 
12, 1972. This book is a compilation of several of the papers and 
discussions presented at the conference, 

A little over a year ago. Gene' Ramp and Bill Hopkins published A WEW 
VIRECTIOU m EVUCATJON: BEHAVJOR AMALVStS 1971. In their foreword, 
they outlined the role of applied behavior analysis in education. 
First, they stressed that the field deals^with behavior r the observ- 
able tfjings that school children, teachers, administrators and parents, 
do. Second, they noted how the field has adopted an approach to edu- 
cation which emphasizes the design,' organization and implementation 
of programs which produce better results' than traditionally have been 
found. Finally, they presented several papers which demonstrated how 
procedures derived from the scientific community - experimentation 
and empirical analysis - served to Improve educational practices and 
procedures . 

The papers published in the present book expand upon those themes. 
If the field is to say that it has models that offer more and produce 
more for the educational community, then it must maintain its scien* 
tific base, and it must continue to attack new problems. '^The papers 
published here demonstrate not only how techniques and procedures can 
be analyzed systematically, but also how they can be used to solve 
practical problems in education. 

Along another important dimension. Ramp and Hopkins also considered 
the Issue of which behaviors ought to be valued most. They concluded 
that we have not yet found broadly acceptable solutions, but that we 
should actively continue to search for answers to the question. As 
Professor Baer noted in his 1971 address, critics no longer argue that 
behavior cannot be modified, but rather that it should not be modified. 
The critics are concerned that if you change a child^s behavior, you 
may also change his inner essence. These are the same critics who ar- 
gued just a few years ago that behavior modification would not work be- 
cause behavior was simply a symptom of underlying causes and motives. 
Sometimes, it is reinforcing to point out inconsistencies in your op- 
ponent's position. It is difficult, however, to ignore the larger 
questions he raises, namely control and accountability within the pro- 
fession. The panel discussion presented here addresses itself to 
those issues. 



vii 



/ 



vi i i 



We have arbitrarily divided the conference proceedings into seven 
parts* The first, Behavior Analysis: Pasty Present and Future^ 
consists of three papers. Although it may seem strange |o talk 
about the past in a field which Is so young, Deborah Nedelman and 
Stephen Sulzbacher bring back p^leasant memories of a boy named' Dicky 
who was the subject of one of the classic studios of applied behavior 
analysis with children* Nedelman and Sulzbacher have compiled a ten ' 
year followTup of Dicky and his progress through school which Is a 
pleasure to read. 

Some of the current problems confronting applied behavior analysis 
are also considered in Part 1. A panel of experts in the field dis- 
cussed the question of standardized jtraining programs and professional 
licensing* Although no consensus was reached, several alternatives 
were proposed* Finally In Part 1, Professor Becker suggests some al- 
ternate techniques behavior^analysls might use to have a greater im- 
pact on education* These Include: ,l) broader public and political- 
support for behavior analysis; 2) development of effective, large- 
scale educational programs with data to support them; and -3) a greater 
role In teacher training at the university level. Becker presents not 
only Ideas, but also data from his Behavior Analysts Follow Through 
Program. 

Part 2, Current Topics in Behavior Analysis^ consists of seven papers 
which address themselves to relatively new^areas of research* Topics 
include the effects of drugs on classroom behavior , -creatlvi ty in pre- 
schoolers* art work, the development of freedom and responsibility in 
elementary school children, the development of phonetic sounds Jn pre- 
school .children, an analysis of open classroom teaching procedures, and 
finally, the integration of normal and handicapped childrennn a behav- 
ior modification preschool* 

Parts 3, 4, 5 and 6 all describe current programs and techniques 4n be- 
havior analysis* Part 3 presents a comprehensive behavior analysis 
program for handicapped children* Part k Includes four papers which 
describe the use of students as behavioral engineers* Part 5 considers 
teacher training programs, the effects of follow-up schedules on the 
maintenance of a teaching program and a description of a consulting 
teacher*s success with a teacher training package* Part 6 Is a mixture 
of current techniques and procedures which include a homeward education- 
al program for a predelinquent juvenile, an auto-pedestrlan safety pro- 
gram for elementary school children, the use of delayed consequences 
to control attendance and disruptive behaviors In a special education 
class, _an analysis of three punishment techniques to control disruptive 
behavior, the .use of relnforcemertt contingencies and teacher- aides to 
alter subtraction performance, and finally, the effects -^f superlmpos- 
ing contracts on a token economy. 
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Part 7, Behavior Analysis in Higher Education^ emphasizes a behavioral 
approach to higher education. The Born et aK study compares the 
study time investment of students in a Keller-style, personalized in- 
struction course with that of students In a more traditional lecture 
course. Johnston and his colleagues provide a fine grain. analysis of 
study behavior as it occurs in the natural environment with data col- 
lected from self-report i nverrtories/ The Miller and Weaver paper dem- 
onstrates how a multiple baseUne~aesign can be used to evaluate teach 
ing effectiveness. Finally, Bos^tow ^nd Blumenfeld report two experi- 
ments concerned with evaluating alternative procedures for awarding 
points to students on the basis of quiz performance. 
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Dicky at 13 years of age: 
a long-term success 
following early application 
of operant conditioning procedures^ 

deborah nedelman 
Stephen L sulzbacher 

When we attempt to evaluate the effectiveness of operant conditioning 
techniques in altering dysfunctional behavior, we will need to look 
for evidence of long-term success* The following case study provides 
such evidence* 

Dicky was the subject of one of the earliest published reports of the 
use of operant techniques with children by Wolf, Risley and Mees 
(I96A)* 'He was 3 1/2 years old and in a state mental institution at 
the time of that study; he is thirteen years old today and is enrolled 
in a regular sixth grade class in public school. 

Most of -you will recall that original paper and the subsequent ones by 
Wolf, Risley, Johnston, .Harris and Allen (1967) and by Baer (1966) 
which reported on the foUow-up work done with Dicky in a preschool 
setting. 

Figure 1 Illustrates in some detail the extent of Dicky *s treatment 
history. Each upward excursion of the line indicates an entry in his 
medical record* At the age of nine months bilateral cateracts were dis 
covered, and he had a series of examinations and surgery before the age 
of two. 

It was after this that he began to manifest the self-destructive behav- 
ior that was to bring him to the attention of behavior modifiers: 
banging his head, scratching his ears and neck until they bled, slap- 
ping his f«ce, etc* At age two years two months, Dicky had his first 
psychiatric v'»si tjJifi_Jat^s diagnosed as ^^psychotic and possibly retarded 
On the second visit a fe^ months later, the psychiatrist noted that the 
mother exhibited depression and manifest anxiety, and referred her for 
psychiatric help. During the next few years there were several consul- 
tations with various doctors and clinics* Dicky was given several dif-* 
ferent labels, but everyone concurred that the chiljd had severe behav- 



Thls research was supported by Maternal and Child Health Service 
Project #913 at the Child Development and Mental Retardation Center, 
University of Washington (Departments of Pediatrics and Psychology)* 
Address any communications to: S* I* Sulzbacher, Pediatrics Depart- 
ment (WJ-IO), University of Washington, Seattle 98195* 



loral problems and more than one reference is made to the mother^s 'Re- 
pressive reaction.*^ 

When Dicky was in his fourth year, his behavior problems had progressed, 
to such an extent that it becamie necessary to place him in the state 
mental hospital for a three month period. It was at this point that 
the group from the Developmental Psychology Laboratory (DPL) at the 
University of Washington wa$ called in to work with Dicky. The group's 
efforts to control his temper tantrums, glasses-wearing and sleeping 
behavior were dramatically successful and are described in the previ- 
ously mentioned references. 
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Fig. L Dicky's treatment history. 
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Upon his return horDe from the state hospi tal , Dicky was enrolled in the 
preschool at the Developmental Psychology Laboratory. Here much effort 
was made to develop Dicky's socialization skills. Since his first three 
years had been spent primarily in hospitals, Dicky had not had the nor- 
mal opportunities to explore his environment nor to interact with peers 
outside of the institutional setting. Although systematic attempts to 
shape social behavior were not considered entirely successful by the DPL 

•group, with neither contingent teacher attention nor contingent edible 
consequences significantly increasing Dicky's interactions, his rate of 
social interaction with his nursery school playmates did increase from 
near zero throughout his first year to a median of. 15^ of his day in his" 

-second year at the preschool. 

A program of tutorial sessions was also begun at DPL by Baer and McCleave 
to teach Dicky to read; his behavior. had to be progressively shaped to 
provide him with the visual discrimination skills necessary for reading. 
Dicky's verbal behavior was originally limited to occasional echoic re- 
sponses, jargon and son^s. To bring this under environmental control, 
Dicky was required to emit on demand the desired behavior to receive 
bites'-of his meals. He^was taught to match and label letters and then 
to mimic names of a series of five pictures. Gradually the teacher wojjld 
omit saying the word first and Dicky soon came to say the word in the pre- 
sence of the picture alone. He then progressed to picture books, common 
household objects, and finally to events which had, occurred at a previous 
time. 

Dicky remembers this period quite vJvidly as was seen in a video tape 
shown at the conference. 2 

When he finished his two years at preschool, Dicky entered the public 
schools in a special education class for the mentally retarded. He ad- 
justed well to this setting and in 1967 entered a special class for the 
physically handicapped. At this time Dicky was re-evaluated at the Child 
Development and Mental Retardation Center, University of Washington, and 
significant progress was found in all areas of behavior, though extreme 
overprotectiveness by the mother was still noted. 

Dicky's ability to handle the academic world had evolved so significantly 
that , by 1969 he was attending regular classes, and is presently enrolled 
in a regular 6th grade class. 

Figure 2 is a graph of Dicky's IQ testing history. You will note that 
at the age of three he was untestable (the Vineland Score came from an 
interview with his mother). His current- functioning l(i is 81, though 



On February 2, 1972 at the Child Development and Mental Retarda- 
tion Center at the University of Washington, a video tape was made of 
a conversation between Dicky and Mrs. Eileen Allen and the present auth 
ors. The tape was, shown as p^rt of this presentation. 



his verbal score is 106, at the upper end of the average range. From 
the age of 7 1/2 to 13 he gained fourteen points on his verbal score. 
The' drop of twelve points in his performance score during this" same 
period reflects his still quite severe visual handicap* 




Fig, 2. Summary of Dicky's intelligence testing per- 
formance. 



As part of Dicky's psychological evaluation, projective tests were ad- 
ministered in 19f67 and again in February, 1972, While some may ques- 
tion the validity of these tests, per se,. it is worth noting that the 
improvement in this child's behavior is correlated wjth a "healthier'- 
profile on these tests. Some of the specifics noted by the psycAolo 
gist were: (with reference to the Rorschach) "Whereas his previiius re- 
cord was flexible to the point of no boundaries to his aonoepts now all 
of his responses appear to be reasonably well related to the inkblots;" 
(with reference to the TAT) "He can now describe what the characters 
are doing rather than merely listing the items in the picture. He care- 
fully describes facial expressions such as straight-faaed^ love-expres- 
sion^ happijy as If he had been coached to do this In social situations." 
The = cone 1 us ion reached .by the tester was: "On the whole, projective 
tests indicate remarkable improvement and suggest that Dicky^i^ at pre- 
sent content with himself and his situation in life. Although he is 
still decidedly dependent and immature for thirteen years, he is not 
overly anxiou§"^, frustrated or threatened." 

Dicky's steady progress has brought him to the point where he is regard- 
ed by his current teacher as a kind and considerate student, well-liked 
by his classmates; a student who works quietly, pays attention In class 
and takes pride In his work* His reading level is appropriate for his 
grade; Most of his reading material Is provided in large print, though 
he can read some regular-sized print, as he mentions in the film. He 
IS receiving satisfactory grades in all subjects except for math and 
handwriting. He has recently begun working with a tutor In math, where 
he Is having some difficulty with long division. 

On a recent trip to his school, Dicky was observed to be generally so- 
cially appropriate and particularly sensitive to the feelings of other 
children who were having difficulty. At a student government meeting 
where be represents his homeroom, Dicky made a plea for greater under- 
standing of the behavior of an underpriv I leged chi 1 d who had been the 
object of petty persecution by other students. 

Dicky still displays some "autisms"'or "blindisms:" rocking In his seat 
and occasionally hand flapping, though his classmates seem to attribute 
this behavior to his visual handicap* Dicky was observed at recess In 
1967 and In 1972 and on both occasions did*not engage in any play activ- 
ity with other children, but his teacher was surprised by this and said 
that it was not common for him any longer. One explanation for his iso- 
late play at recess Is that his poor vision would Interfere with any 
ball games, which -were the predominant activity. 

Dicky will be entering a regular junior high school class next fall. 

Dicky's ability to participate In a prolonged conversation and his ap- 
propriate-use of a relatively sophisticated vocabulary were evident 
when we talked with him. The conversation covered many diverse areas, 
from his memories of nursery school where Mrs. Allen was his teacher, 
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to his current bowling score. Dick/ talked about himself as being 
*^handi capped" and by this, as he explained, he meant visually impaired, 
Here are some quotes from the videa tape of that conversation: 

Discussing an earthquake that *oi.UftVvtuwhen Dicky was 
in the DPL preschool.) 

e': Tell me about it, Dicky, I wasn^t there* 

D :* It was a pretty bad earthquake. I was in the build- 
ing All of a sudden without the slightest warn- 
ing it happened. Everything got knocked over 

^cause the vibration was so great. 

^'(Discussing his current' friends J 

D : Mark and Larry and Greg are my best friends. Greg is 
kind of handicapped, too. 

2 

E : In what way? 

D : He has a problem talking just like I have a problem 
seeing. We don^t have too many handicapped kids in 
our class. 

E^: Any "others? 

D : ♦...Well, probably about a fourth of the class wears 
glasses. 

^(Discussing his impairment*) 

D : ...I could see gooo when I was a baby, but by the time ! 
was about eight or nine months old I started having 
trouble with my eyes—cataracts. 1 was almost blind then. 

2 

E : I remember, you had some operations on your eyes. 

D : Five. I was a I most- b I i nd . I couldn't hardly see anything. 

2 

E ; When you were about 3 or 3 1/2 you started learning to 
wear your glasses. 

D : Yes. But my eyes got a little better... 
2 

E : ...Can you read regular print now, or do you have to have 
special pri nt? 

- D : I can read regular print to a certain extent. I can^t 
read small print, newspaper print. 



DISCUSSION 



It can be seen that the prediction made by Wolf and his associates that 
Dicky would become increasingly verbal and ''a new source of joy to the 
members of his family" and, '^perhaps, through the continued efforts of 
his parents and teachers he- may develop into a productive citizen," is 
coming true. Some remnants of his "autistic" behaviors are still evi- 
dent to the trained observer, but neither his teachers nor his peers 
seem to notice. 

#- 

There is no evidence that any new deviant behaviors ever were "substi- 
tuted" for those which were the object of his early treatment. However,^ 
Dicky has been extremely forfurT§te in having had exemplary teachers who 
have continued to use classroom procedures compatible with those which 
were initially so successful. The case of Dicky supports the conten- 
tion by Lovaas (1968) and Sulzbacher and Costello (1970) that the lives 
of seriously handicapped Children can be materially enriched by early 
intervention using the behavior analysis model and follow-up over a 
period of years to insure generalization and continued acquisition of 
new^ skills. 
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Behavior ANALYSIS & education 

-1972 
weslmy c. becker 

As I look at the progress of behavioral approaches in psychology and 
education over the past decade, I am really amazed at the impact a few 
people like Staats, Michael » Wolf, Bijou and Baer have been able to 
make on research methods in psychology and applications to social prob- 
lems. Most of us at this conference are testimonials to their influ- 
ence. 9 

The decade has produced many procedures for eliminating or changing be- 
havior problems in a variety of settings. The decade has produced pro- 
grams for training parents, teachers, and college students in the bas- 
tes, of behavioral analysis and its application In control ling problem 
behavior. A small beginning has been made in the building of instruc- 
tional systems using behavior knowledge. We are practically nowhere In 
working out applications to the administration of educational systems. 

As a person out in the field of public education, I see that we are at 
a critical point where whether we stand 5till for the next decade or 
have the chance to make an impact on education at all levels is going 
to depend on three things: 

1^ gaining a favorable public press and 
political support for behavior analy- 
sis; 

2^ producing educational systems that 
teach efficiently and positively, and 
data to show this; and 

3^ getting a foothold on teacher train- 
ing at the university level, and pro- 
ducing procedures for training per- 
formance competencies which affect 
chl Id learni ng. 

There is currently on Elliot Richardson's desk, the Hively report on 
applications of behdvior analysis^^o education. If acted on, groups of 
us could very readily organize to:9 (l) implement field use of current 
knowledge on applications of consequences in schools, and (2) produce 
the next generation of research demonstrations required on teacher train 
ing and on instructional systems. 
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A better public press and active political support Is required, however, 
to bust this report loose in the face of- -rl t Id sm of behavlorlsts by 
uninformed pol I ticlans. and journalists, similarly, the directions taken 
by a National Institute of Education, If it ever gets going, are right 
now critically sensitive to any public impacts we can make In the near 
future, 

I am amazed at the disservice some behavlorlsts do to each other in ex- 
plaining themselves to novice students and to the lay public. Questions 
of control, of responsibility, and of freedom have been poorly handled 
in most cases. Skinner's latest book. Beyond Freedom and Dignity, has 
been misinterpreted because it falls to present* the Issues In a way that 
deals adequately with current belief and expectations. Besides the 
Agnew attack. Skinner has been, attacked on the floor of the House by 
Cornelius Gallagher for "advancing ideas which threaten the future of 
our system of government." Well, we know this Is not true--but the at- 
tacks cannot be Ignored. I have read many manuscripts In the past year 
where behaviorists are trying to explain to teachers or college students 
why man is not free and not responsible, and that these things are just 
Illusions.^ It doesn't do much good to assert this wl thout explal ninq 
the I lusion." I think that there are some better ways of dealing with 
these issues. * ^ 

Allow me to get didactic for a few minutes, and suggest one analysis 
which deals with the problems of freedom, control, and responsibility 
in a way which I ihlnk we can sell to most reasonable human beings. I 
know Dick Mai lot could do a more creative job of getting these Ideas a- 
cross, and I hope he will give it a try. 

Do Behaviorists Deny That Man is Free? 
There are two answers to this question: 

The First Answer. If by /ree^we mean that man has a free will and can 
autonomously decide for himself what he wl 1 1 do Independently of Influ- 
ences upon him from his environment, then behavlorlsts must aslert that 
man is not free. It is quite clear from experimental work that behavior 
IS controlled by environmental events. This statement, however, is 
equivalent to saying that people learn what they are taught by their en- 
vironment. Notice how readily some^ould accept, this latter statement, 
but still want to deny that behavior Is controlled by our history. In 
any case, it is this concept of freedom which Skinner Is asserting to be 
Illusory. That we learn what we are taught should be obvious. Few of 
us speak Russian or French or German, because we were not taught those 
languages by our parents. 

The Second Answer. If by free we mean that. man frequently faces choice 
situations and his political system allows him to make those choices ac- 
cording to his own hi story. of experience, without aoeraion, then man can 
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'be free. In choice situations, men choose the ipore rewarding and less 
punishing alternative as determined by their prior experiences. Choice 
behavior is determined like any other behavior. The issue of freedom 
of choice arises when other people have power to force us to make choices 
we would not choose because of our prior histories. When a parent forces 
a child to go to bed, but the child wants to watch TV, the child is ex- 
periencing a loss of freedom. When the state passes a law requiring man- 
ufacturers to stop polluting waterways under threat of penalty,* the man- 
ufacturers are losing a freedom of action they once had. When a man 
signs a marriage contract with a woman, he is entering into a legal con- 
tract that usually restricts the choices he can make of sexual partners. 

I realize most of you understand these things, but indulge me a little 
more. Through centuries of philosophic thought, confusions have existed 
In understanding freedom of choice and lawfulness in behavior. The con- 
fusions can be largely attributed to_ conf us ions in the meanings of words. 
Consider the following concepts: 

"Natural Laws''^ Man^ Made Laws 

' uuuuuuuuu a uu uuuuuuuuuuu 

Describe what is Prescribe what should be 

Determinism vs. Chance Coercion vs. Freedom of 

Choice 



Much misunderstanding can be avoided if we first clearly distinguish be- 
tween natural laws and man-made laws. Natural laws simply describe the 
way we understand things to be in nature— what leads to what. For ex- 
ample, preceding stimulus events control reflexes; or, water boils when 
heated to 212*" at sea level. As some wag put it, ''nature doesn't violate 
her own laws," and being part of nature, neither do we. We can't. 
That's just the way It is. Theoretically, natural laws are true whether 
we like them or not, whether -we know them or not. Man-made laws on the 
other hand, prescribe what you should do and the consequences for not 
doing something. Men make them and men can change them. They are not 
true, but only potentially useful. All explicit or implicit contracts 
and agreements between people have a similar prescribing function. The 
obligations of people to each other are what defines a social system, a 
society. 

With the notion of natural law versus man-made law clearly in mind, let's 
consider the other concepts listed above. In science, determinism is the 
working hypothesis that there is lawfulness (consistency) in nature to be 



Of course "natural laws" are man-made statements, but the proces 
ses referred to are not man-made. 
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discovered. The opposite of determinism is chance. If something is 
not orderly and consistent, then it is random. Throughout philosophic 
history^, it has been asserted that freedom is the opposite of deter- 
minism, and, therefore, if one is true the other cannot be. But, this 
is not the case. In the natural world the opposite of determinism is 
chance, and in the man-made societies the opposite'of freedom of choice 
is being coerced or forced to do what you would not do if the coercion 
were not present. Thus, if we clearly examine the meanings of the 
words involved in this issue it is not hard to come to a reasonable 
resolution. Behaviorists can readily agree that some forms of social 
systems involve more freedom of choice for the people than others. 
Most behaviorists would go further and say that with our current know- 
ledge, it is possible to design even better ^social systems where there 
is less need for coercion (punishment), less misery, less threat of 
future destruction of mankind; and more individual choices, more hap- 
piness, more accomplishments, and more appreciation of living. 



Do Behaviorists Deny That Man is Responsible? 

If man*s behavior is determined^, how can man be considered responsible 
for his actions? As with freedom, the question is based on a misunder- 
standing. Responsibility is assigned to people by man-made laws and 
contracts. For example, laws of state make parents responsible for 
their children, not laws of nature. The assignment of responsibility 
by man-made laws and contracts, does not necessarily make a man respon- 
sible. It simply specifies the penalties for failure to live up to a 
responsibility or the rewards for doing so. Many are punished for fail- 
ing to live up to their responsibilities. Man is law abiding and re- 
sponsible if, as Chuck Salzberg (1972) pointed out this morning, he has 
been trained to be so by others in his society. The current knowledge 
from behavior theory provides parents and others with the knowledge need- 
ed to train children to be responsible citizens. Behaviorists need not 
deny the validity of contractual systems and the responsibilities im- 
posed by them; in fact, they are in a position to show the world how to 
build better contractual systems through empirical analysis of effects. 

The dilemma we are in. has in part been generated by our zeal to extol 
the virtues of functional analysis, and to put down hypothetical-deduc- 
tive research. But, the effect has been to fail to teach our students 
that there is a time for thinking about what you are doing, a time for 
logical analysis in considering what we know and where we can go with it. 
We have failed to teach our students to distinguish between evaluation 



See Schlick, Moritz. Ppoblens of ethics. New York: Prentice- 
Hall, Inc., 1939. 
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which is functional and design which is procedural. 3 Note that nearly 
all of the papers in this conference deal with the evaluation of compar- 
ative designs. The functional-procedural distinction underlies the dif^- 
ference between basic and applied science. 



♦ "NATURAL LAWS" » MAN-MADE LAWS 

Describe What Is Prescribe What People^ Should Do 

Determinism vs. Chance Coercion vs. Freedom of Choice 

• EVALUATION •DESIGN 



What Is (functional definition) What To Do (procedural definition) 

Z Logical Principles of Experimental 
Design 
...^^^ — ^-Design of Trial Physical Systems 

Evaluation of Engineered Systems ^^Redesign of Systems & Generation of 

Principles to Aid Future Designs 

Logical Principles of Experiment-al 
/ Design 

Empirical Principles of Behavior^^^Design of Trial Behavioral Systems 

Evaluation of Engineered Behav-^^^— ^Redesign of Systems & Generations 
ioral Systems - of Principles to Aid Social System 

Design 

Empirical Principles of Behavior— ^Design of Instructional Systems 

Evaluation of Instructional ^^r"^——^ Redesign of System & Generation of 
Systems Principles to Aid Instructional 

System Design (Includes Principles 
of Teaching) 



Fig. I. 



For the novice to behavior theory, functional analysis involves the 
controlled demonstration that certain environmental events affect behav- 
ior in certain ways. Functional definitions specify an environmental e- 
vent, a procedure for using this event, and an effect on behavior. (It 
is a reinforcer if it follows behavior and strengthens its future rate of 
occurrence.) The design of systems is a logical process in which proce- 
dural definitions are used. For behavioral systems procedural definitions 
would specify environmental events and how to use them in relation to be- 
havior, but not specify the outcome or behavioral effect. ("We are going 
to use these tokens and these back-ups as reinforcers in our system.") 
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Refer to Figure 1 in considering the following discussion. Functional 
evaluation procedures are used to find out what is. Logic is used to 
design procedures for operating on the environment. In the laboratory 
we start with the logical requirements of an experiment. How can we 
find out what is going on? One rule is to change only one thing at a 
time. Another is to repeat the procedures to be sure the effect is 
real. Experimental designs are used to find out about functional rela- 
tions. In the physical worlds these relationships are called the prin- 
ciples of physics. These principles are then applied in the design of 
man-made physical systems. This is called engineering. Systems once 
des'ned are evaluated for their functional characteristics just as 
^'naiuraV' systems were. Evaluation then is follcjwed by redesign and 
the generation of principles of engineering. Recycling can occur here. 
Note that the principles of engineering are not true, but only useful. 
Someone could design systems that work better tomorrow and produce new 
design principles. 

A similcir Interaction of logical and empirical processes follows in the 
behavioral world. Logic guides experimental design. Empirical general- 
izations are found and applied to trial behavioral systems. These are 
evaluated and redesigned. Principles of social engineering may also be 
an outcome. The kinds of questions answered might be, **Who should con- 
trol the reinforcers or punishers In a community like Achievement Place?** 
'*What should be used af reinforcers for these drug addicts?*^ **How should 
the contracting arrangements between teachers and high school students 
be arrived at?*' The basic question is always which procedures are more 
effective under given conditions, given a criterion of utility? 

Let me return now to where we are going. My major point in focusing on 
these conceptual distinctions Is that we all need to be smarter in coping 
with unwarranted attacks. We need to be able to show those who attack 
on the wrong basis just where they are misunderstanding what we are doing 
We need to be better teachers, and we need to be pol i ti cal- about it, or 
we may be in for repressive attacks. 

Now this analysis I have given you, just happens to also lay out for you 
a framework within which to consider where we should be going. What are 
we shooting for? As I said earlier, I see a need now to produce demon- 
strations showing how we can use our growing sophistication to produce 
efficient educational systems, including educational environments, and to 
improve teacher training. We need to be designing and evaluating the be- 
havioral systems which will someday provide the principles for the field 
of social engineering. 

Those of us working in Follow Through (Bushel 1, Engel.tiann, and myself) 
have been trying to develop such systems and demonstrations. Let me 
just give you a very brief summary of the system we are using In twenty 
school districts with 10,000 disadvantaged children. 
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The Engelmnn^Beaker Follow Through Model 

The goal of our model is to teach poor kids more, not less. There are 
six basic components to the system we devised;* 

•1. We increased the manpower in the classroom by add- 
ing two aides* 

•2. We structured the daily program so that the teaching 
personnel had a clear plan of action, 

•3. We provided daily programned lessons to insure that 
the teaching personn^^l knew what was to be taught 
in what sequence. 

We instituted a teaching method that utilizes basic 
behavioral principles to insure efficiency in teach- 
ing. 

•5. We provided for^training in the use of the programs 
on a continuing basis, 

•6. We monitored the progress of the children and the 
skills of the teachers and aides to be sure the sys- 
tem was functioning. 

The keys to this model which are different from other current behavioral 
instructional systems are: (1) M^a£/4 in \diLck EnQoXmnn hoA p^ognamrndd 
tka in^tmctional mtejUaU to tmch a ganvwl ca^d, Tki^ pKog^iamning ijo- 
ca^eA analij6a^ on concapt^ and opmution^ n<L<Ld<Ld at kigkeji IdvdU o{^ tha 
p^ognam, natkzA than tcu>k analy^Lb, in moLking duign dz<iUloM; (2) tka 
packaging o{^ ' tha lYU^tAucXional mtVtlaU into daily lu^on^ to be givan 
by an aduJU tJOoKking uoitk 6ma£l g/L0up6 children in diAdct iMt^ucXion,^ 

Figure 2 provides an example of material from a teacher's manual (now pub- 
lished under the trade name DISTAR, by SRA)* Each lesson day is broken 
down into a number of tasks. The vIsuaTmaterials the teacher needs for 
that task are provided, or she is instructed what to draw on a chalkboard* 
She is given further instructions on what she should do (in black) and 
what she should say (in color). The required child responses are given 
in italics. Aides who are parents pf poor children can learn to teach 
with these materials with two weeks preservice training, two hours a week , 
inservice, and periodic supervision in the classroom. ^ 

Efficient teaching aims at getting a high rate of correct child responses 
within the teaching time available. To accomplish this, the teacher needs 
to know the formats in the program \N/el 1 . She needs to know how to use 
attention signals most appropriate for each task and must learn to use a 



See Becker, Wesley, C. , Engelmann, Siegfried and Thomas, Don, 
1971. 



Praise the children for correct responses. Correct mistakes imnedlately. 
TASK 2 

Group Activity 

Q. Point to the, dogs. What are these? These are dogs. Call on one 
child. Find the dogs that are little. Everybody tell me aDout ^ 
these dogs. Repeat using the dogs that are wearing a hat» are big, 
and are not wearing a hat. 




Point. Is this dog little? Yes. 
is this dog wearing a hat? Yes, 
Is this dog little and wearing a 
hat? Yes, Say the whole thing. 
This dog is little and weoi^ing a 
hat. 




C- Point. Is this dog little? 
Yes. Is this dog wearing a 
hat? tio. Is this dog little 
and wearing a hat? Ho, Say 
the whole thing. This dog 
is not little and wearing a 
hat. Why not? This dog is 
not weaving a hat. 





Point. Is this dog little? Uo, 
Is this dog wearing a hat? Yes. 
Is this dog little and wearing a 
hat? .Vo. Say the whole thing.^ 
This dog is not litt\e and wear- 
ing a kat. Why not? This dog 
is not little* 



0. Point. Is this oog little? 

? iVc>« Is this dog wearing a 
hat? No. Is this dog Tittle 
and wearing a hat? No. Say 
the whole thing. This dog 
is not little and wearing a 
hat. Why not? This dog is 
not little and not wearing 
a hat. 



individual Activity 

f. Call on individual children. Point to a picture. Is this do^ 
I itt le and wearing a hat? I f the dog is not little and wearing 
a hat, ask: Why not? 

Correction Procedure : If children answer "Is he little?" by 
saying, "No, he Is big." say: Yes, but is he little? If chil- 
dren have trouble, point to a dog. Is he little? Is he wearing 
a hat? When a child says "No.">say: . W^ll, that's why he's not 
little and wearing a hat. He is not I title (or) wearing a hat. 



Fig* 2. An example of teacher material from 
the D I STAR Language I Program. 
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variety of signals to get the children to respond together (or individ- 
ually) on cue. These latter signals we call "do It" signals, since 
they tell the chMdren it is their turn to "do Jt," In small group 
instruction, "do J't" signals are critical in being sure each child 
learns what the teacher is teaching, rather than just imitating what 
another child is saying. The teacher also needs to learn how to pace 
each task appropriately, quickly enough to hold attention, yet going 
slowly when required to give the children "time to think," 

The. teacher needs to learn to use reinforcers effectively to strengthen 
correct responding and to correct mistakes in a way which permits all 
children to learn each task (criterion teaching). Efficient correction 
procedures are based on an analysis of the kinds of errors which can be 
made. For elementary tasks, there are just three, the corrections for 
which are easily taught. The main point we wish to make through this 
discussion of training is that within a behavioral instructional sys- 
tem, the performance requirements for teachers (includiiig aides) can be 
specified and thus training procedures can be devised. Trainers know 
what to do, teachers know what to do, and children learn. 



Some Illustrative Outcomes 

One interesting outcome Is a demonstration that teaching makes a dif- 
ference. There is very little data in education today which show 
this. Figure 3 shows classroom means for scores on WI^T reading plot- 
ted against classroom means for final day in program for DISTAR read- 
ing. The figure is based on data from 3,700 children. This graphic 
display indicates a very close relationship between the number of les- 
sons taught to children and their test scores. The plot for reading 
is a consistently linear function. This function implies that efforts 
to ensure that more lessons are taught each child during the school 
year will lead to improved rates of skill development. 

Figure k gives two-year gains for different grade groups in reading. 
To save time, the children for whom there was no data in 1972 were 
not eliminated from the previously calculated gainr Thus, there is 
sofr.3 distortion in viewing the data as pure gain sc.-^^. However, the 
findings are powerful. With a tittle extrapolation, it can be seen 
that the gain in reading from pre-klndergarten to post-third grade Is 
4,3 grade levels. The gain from pre-first grade to post-third grade 
is 4,1 grade levels. Keep in mind that the expected gain for econom- 
ically disadvantaged children has typically been reported at about ,6 
grade levels per year. Also note that the gains by children starting 
in kindergarten are nearly the same as' those by children starting in 
first grade. This evidence strongly contradicts opinions that kinder- 
garten children are not ready to learn to read, and the data are on 
disadvantaged kindergarten children. 
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Fig. 3* Relationship of average final day 
in program, DISTAR Reading, to Wide Range 
Reading performance. Based on 3,700 chil- 
dren. Each dot is a classroom mean. 
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GiADE KK1 K12 113 111 133 13 

DATJI YEAR 19 '71 *72 ll It 1% '71 '72 '71 '71 '72 '7t '71 '72 '«S '71 

N: 245 193 567 437 174 132 256 _237 577 309 



Fig 4, Wide Range Achievement Test 

Reading scores for poor children in 

the program for at least 130 days 
per year. 
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Figure 5 plots the gain scores from Figure k against lesson days taught 
in DISTAR reading for the periods of the gain. The figure shows a 
close functional relationship between gains in lessons taught and gains 
in WRAT reading performance. Whether the children start in first grade 
or kindergarten can be seen to have little effect on gain scores (par- 
allel slopes), but children starting in first grade tend to start with 
more ski 1 Is. 




Fig. 5. Reading gains on the Wide Range 
as a function of lessons taught. The data 
are for the same six groups, -presented in 
Figure 4. 
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The Important benefits of starting reading earlier is further supported 
by the analysis in Figure 6, Comparisons are made at the end of first 
grade and at the end of second grade between groups of children who had 
our kindergarten program (E-B KG*) and those who had a traditional kin- 
dergarten or no kindergarten* At the end of the first grade, those 
children with our kindergarten program were grade levels ahead of 
the other two groups. At the end of second grade, these same children 
were one year ahead of the other two groups and more than one year above 
grade norms. This kind of evidence shows that just any kind of kinder- 
garten experience will not necessarily contribute to the development of 
reading skills. It also shows that one way to give disadvantaged chil- 
dren a running start in skills they will need to be successful In school 
is to start teaching them earlier, 

W.Ri.T. READING POOR CHILDREN ONLY 




Fig, 6, Analysis of the effects of no kindergarten, 
kindergarten but not Engelmann-Becker kindergarten, 
and Engelmann-Becker kindergarten on reading levels 
at the end of first and second grader— 
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These findings are just a beginni.ng — in showing what can be done. We 
have the potential for making a great impact on education and society 
more generally in the coming years. There is going to be a need for 
more of us working together to gain public acceptance and understand-* 
ing, and tes-ting out the properties of various kinds of behavioral sys- 
tems on a large scale basis. 

I want to close by thanking the Department of Human Development, the 
Follow Through Project, and Don Bushel 1, Jr. for hosting an exciting 
confe rence. 
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•JACK MICHAEL: 

There are a number of issues we want to consider, but we haven^t 
planned anything very organized. Scott Wood and I went over several 
problems regarding training and behavior modification that we thought 
would be useful to consider. One problem Is the pressure from con- 
sumers for some type of professionalism. Now that we have an applied 
science, we are beginning to come under new pressures. At the same 
time, many of us have not been very sympathetic with the traditional 
clinical psychologist's concern for standardized training programs 
and licensing. Clinical psychologists have tried hard to decrease 
the likelihood that someone could pass himself off as a real clinical 
psychologist when all he really knew was astrology. Now the shoe Is 
on the other foot. People frequently claim to be '^behavior modifiers, 
but they are reaily not qualified. We are beginning to feel the pres- 
sure for standards, licensing, standardized training procedures and 
the use of labels. The problem Is that there are always people pre- 
sent who will call themselves whatever seems useful at the moment, 
and who will offer services that they cannot provide. Already, a num- 
ber of us have received Inquiries from agencies about how to decide 
who to hire, which projects to fund and which services to support. 
Will the REAL behavior modifier please stand up? 
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•JON BAILEY: 

1n Florida, we recently had a case which indicates a real need for some 
kind of monitoring of behavior modification programs. A psychologist 
who worked for a large institution for the retarded in Miami claimed 
to be a ^^behavior modifier.^* As it turned out, the program he set up 
was simply a severe case of abnormality on the taff'5 part in the 
NAME of behavior modification. For example, a child who %as caught 
stealing something would be forced to wear a sign, front and back, 
saying, "I AM A THIEF." Everyone would address him as a thief. Chil- 
dren caught engaging in hom<^sexual activities were forced to re-engage 
in those activities in fronfi of other staff members and patients. 
And, this was carried out ir^ the name of behavior modification. Local 
news media reacted Immediately. I think this case is an example of 
the issue being discussed": 

Todd Risley was a member of a panel appointed to investigate the inci- 
dent. We owe a ^reat tribute to him for pointing out how this was not 
a behavior modification program, but rather how it involved bizarre 
people doing bizarre things to reta.:ed chiidren. His efforts r<55ulted 
in some very clear statements about the use of behavior modification 
in retardation. For example, he emphasized the notion that you rein- 
force behavior that you want and that you punish behavior that you do 
rot want, but that in the present cose, the **punishment'' was completely 
out of line. There was definitely something inadequate and inappropri- 
ate a^L the training those staff members received. Todd, would you 
want to make some comments? 



•TODD RISLEY: 

This is a case I would not really discuss except that the state of 
Florida has already made public the confidential report that the com- 
mittee made. - It was a rare opportunity to examine all the workings 
of a mental institution, to have access to all of the information and 
to be able to interview anybody in the institution. So, I learned a 
great deal. Let me characterize what happened. 

The psychpTogiit Jijw^Wed^^^ including the Ph.D. They 

were, in most respects,- gooll'tredentials for doing something other 
f-han what he was hired to do. In the areas in which he had training, 
he did an exemplary job. However, he had responsibility for which 
he had no training--deal f ng with Juvenile delinquent kids who happened 
to score 69 on an IQ test and wRo"fnstead of getting sent to jail got 
sent to the institution. They were big kids, problem kid^, potentially 
violent and dangerous kjds. In the absence of any training dealing 
specifically with this population, he built an upside down token econ- 
omy in which the worse the bt'^avior, the more remote the consequences • 
As a result of undesirable behavior, the child was sent to a ward where 
facilities, food and everything else was unsatisfactory. He then had 
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to accumulate a large total number of token points to get out of this 
ward, and into the next ward. He could not buy anything; all he could 
do was save them until he had accumulated a very large number and 
then he could buy his way into the next urogram where he could finally 
spend the tokens he had earned. Now you can begin to see what would 
happen. Once a child fell out of the top system, He fell all the way 
out. He then got into a system where the contingencies were much more 
remote and delayed. In the context of this program, they had a lot of 
problems with the youths on the lower programs and the problems in- 
volved big kids, many of whom the staff feared. 

The psychologist had no effective technology for dealing with this sit- 
uation. He had some general rules, like "emphasize the natural conse- 
quence% of behavior," a general statement which makes sense in an ab- 
stract way, but very little practical sense without a good deal of elab- 
oration. Another general strategy was, "in the absence of a prescrip- 
tion for behavior, do something, try someth I ng-- i t wl 1 1 be reviewed 
later." 'When the staff tried something and I.t seemed to fit the first 
rule. It would be approved, or at least, not disapproved. Another rule 
was that you had to "follow up on any contingency statement that you 
make." That meant any threat or promise you made you had to back up. 
These rules make sense, but only In the context of a -technology for 
dealing with the problem. Let me give you an example of how these three 
rules could be used, (l) Emphasize the natural consequences of the be- 
havior: a resident was seen masturbating, so this was defined as mas- 
turbation In public, an inappropriate form of behavior in our culture. 
(2) Now atteinpt to emphasize the natural consequences of the behavior 
by calling otheV people's attention to the act In public, (l am not 
making this example up; this was the approximate sequence of events ac- 
cording to the cottage log books.) When an attendant caught a child 
masturbating, he drew all the other kids' attent ion— the "natural con- 
sequences" of public masturbation is public ridicule. The next time 
the resident was "caught," he stopped Immediately and there was no op- 
portunity to call everybody around. (3) However, the attendant had 
previously announced that when anyone was seen masturbating in public, 
everyone would laugh at him— and this contingency statement must be fol- 
lowed up. So, perhaps it seems reasonable to coerce him Into re-engag- 
fng in the act and then call everyone to ridicule him. This procedure 
escalated In regular steps such tiat the resident stripped and re-engaged 
In public masturbation In front of other residents and staff. You can 
see a sort of logical progression in an isolated ward where there was 
no feedback or checks, no peer review, no Interaction with the larger 
community. The basic thing is that the psychologist came Into the sit- 
uation with no prescriptive program. He had no technology. He had 
been trained to deal with principles or even with behavior problems in 
other populations in other places. But he had no technology for dealing 
with those kinds of problems. Furthermore, there was no way those who 
hired him could know he had not been trained to deal with these problem 
beha\jiors. This is probably a good example to deal with. 




•JACK MICHAEL: 

There seem to be several options at this point. One approach Is the 
one that other professionals In psychology have adopted--they agitate 
for state licensing, set forth generally agreed upon standards that 
constitute appropriate training, and attempt to protect the title 
by making It unlawful to label yourself as a "behavior modifier'* un- 
less you have been licensed. Another approach would be simply to 
come In under the umbrella of clinical psychology. This has Its dis- 
advantage In that many of us would not want to learn things that. we 
do not value, and we would not generally consider them qualified to 
teach us some of the things we do value. Many of us find the licens- 
ing alternative equally repugnant because we would have to spend a lot 
of time telling people what they haviB to learn and what they have to 
teach others. The alternative of doing nothing is not entirely satis- 
factory, either. 



•ROBERT HAWKINS: 

I am very averse, as I suspect a great many of you are, to the notion 
of licensing. It seems to me that it would produce a static profes- 
sion. I would have to opt for doing nothing rather than licensing. 
At the same time, however, it seems that it might be functional to 
write some general guidelines. A collection of behaviorally oriented 
people from various settings might write some general prescriptions 
that, could be circulated among state administrators, local administra- 
tors, and the sort of people who are going to hire behavior modifiers. 
Perhaps it would be sufficient to give them some clues about things 
to look for, what training usually consists of and how to find out 
whether someone is competent. 



•vhLLARD DAY: 

I would not have thought that it was the natural thing for a behav- 
iorist to want to set up licensing as an important part of the over- 
all contingencies. If we are going to change. something, it seems to 
me that we should ask what sort of overall changes we can make which 
will enable us to fit in with natural social contingencies. The 
idea occurs that if you have to license someone to be a behavior modi- 
fier, then eventually you are going to have to license people to be 
people. 
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•HOWARD SLOANE: 



I tend to agree with the last two speakers; however, I would like to 
expand on the idea of changing social contingencies. It would seem 
to me that before we become concerned with things like licensing or 
setting up criteria for training, we should know something about what 
we are licensing and what kinds of things we want to train, I do not 
think we know that now, I do not think we have any demonstrated, 
highly effective training programs that we can say are models. We do 
not have anything solid, we can say about what everybody should learn.. 
Right now, I think a-maVe in that direction woi>ld be premature and 
only inhibit change and development. Specifying competences in a li- 
censing situation really concerns me. For example, when I think of 
the kinds of things we are doing now compared with our professional 
activities two years ago or iFour years ago, things are really changing 
too quickly for the kind of specification that Is implied In licensing 
procedures. I really feel that licensing and general criteria depend 
upon having enough experience to feel confident In defining your prod- 
uct. I don't feel that confident at present. 



•ROBERT HAWKINS: 

Perhaps the sentiment is great enough amo.ng competent behavior modi- 
fiers AGAINST licenr.ing that what we should do Is write guidelines 
suggesting specifically that administrators NOT call for licensing. 
For a number of reasons licensing may be an attractive step to some 
administrators. If we don*t do something like this, a licensing move- 
ment may get started and end up being something that we don't want at 
all. Maybe we should take a specific stand against licensing and make 
very public our reasons for opposing it. 



•JACK MICHAEL: 

One of the initial steps many professions make is to form a profes- 
sional organization, and prior to any licensing, set up committees 
-that try to determine guidelines. Perhaps, we are at the stage where 
some kind of general meetings where opposition to licensing and other 
approaches to the issue are considered. The general consensus seems 
to be that licensing as in electrical engineering, clinical psychology 
and medicine, is very unsatisfactory and that most people would be op- 
posed to it. 
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•TODD RISLEY: 

There is another piece of information which has not arisen here. 
There Is currently a move to establish a certification board for **be 
havior therapy." The plan Is to have an appointed group of noted, 
semi-noted and (to me) unknown people constitute a board which will 
pass judgujent on subsequent people^s membership status. A nuiriber of 
peoplje^liave expressed opposition to this approach. 



In considering certification, the proposed APA Guidelines on human 
experimentation and the 3OO or so articles submitted to Jcniryial of 
Applied Behavior Analysis in the past year, I have come to the conclu- 
sion that we should not license people, but that we should license 
procedures. I think we can formally classify procedures as those 
which are established and documented and those which are still ex'per- 
iwntal. Perhaps we can establish a coimnlttee which reviews proce- 
dures periodically and determines when a procedure Is no longer ex- 
perimental, but should be considered a standard therape^utic proce- 
dure. Anything that is not in that category should be cpn/idered ex- 
perimental and all of the checks and balances on human experimenta- 
tion should be applied. My tentative solution, therefore. Is not to 
license people but to certify, specify, or define and delineate stan- 
dard procedures whibh are no longer of interest to the experimenter 
but which should be readily applied as therapeutic. 



•AUDIENCE MEMBER: (Beth Sulzer-Azarof f ) 

I think that one of the first things we should do is define "behavior 
modification." I have read several different definitTons and I don't 
think there are any acceptable standards. For example, would you call 
a child who is a tutor a behavior modifier? I prefer to call him a 
contingency manager. We can talk about someone who is an aide In a 
hospital or a teacher or a col lege. student as a behavior modifier, and 
yet I would prefer not to call him a behavior modifier, because heHs 
not bound by the constrictions that sophisticated behavior modifica- 
tion requires of itself. We should restrict the, name "behavior modi- 
fication" to an analysis of behavior that is control led, objective and 
measurable. If we adopt such a definition, we no longer have the di- 
lemma that the clinical psychologist has because we have data that 
demonstrate accountability within our profession. Anyone calling him- 
self a behavior modifier must be able to present evidence that he 
has been able to function in the role of collecting objective data, 
designing behavioral procedures, and hopefully bound by some kind of 
ethical restrictions . 
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•JON BAILEY: i 

I want to make a comment about the consumer pressure for professional- 
ism. It seems to me that we shave caused part of the pressure our- 
selves. I have yet to know a behavior modifier who was not also try- 
ing %o ''sell" a -system* He wants to "sell" the approach to anyone who 
will buy It. As a result we have made statements to the .effect that, 
"Well," anybody can do this. You don't have to be a Ph.D. All you have 
to know are a few basic principles and you can change behavior." We 
were teaching kids to modify behaviors of other kids. And, to some 
extent we are going to worsen the problem by creating demands that we 
cannot meet. If the demand for trained behavior modifiers exceeds 
what we- can supply, then we are going to attract people on the fringes 
who took one course in learning and trained an animal to press a bar. 
Then somebody says, "Hey, l*ve got a kid with a problem" and they take 
it on. The reason they hire the guy is simple--they do not have some- 
body who really knows what he is doing. Perhaps we should do a little 
more training and a little less selling. 



•ROBERT HAWKINS: 

I don't know whether this summarizes it, but it seems that there are 
two major issues. First, there is a need to protect our scientific 
status as researchers so that we are not told by others what kinds of 
things we can investigate. That is, we want to continue as scientists 
without some outside agency telling us whether we are proceeding ade- 
quately or not. On the other hand, I think the field has grown large 
enough so that we must be accountable for what we do, not in our lab- 
oratories, but in our applied work. In some sense, we should protect 
the public from people who claim to be behavior modifiers but who 
aren't. The term "behavior modifier" is not a set of credentials. 
It's a term we use for people we know. 



•DAVID BORN: 

# 

I would like to make a comment. There is another move softer than li- 
censing that might solve a couple of the problems, and that is to ac- 
credit behavior modification training programs. Presumably APA*s 
Division 25 could select a committee that would review programs at 
the university level and accredit programs that, by whatever their 
standards, we're acceptable. The advantage of this is that consumers 
who are interested in hiring behavior modifiers would have a specific 
place to go and furthermore, departments would have some way of know- 
ing whether or not they had a reasonable behavior modification train- 
ing program. 
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•JACK MICHAEL: 

This is the same step clinical psychology took even before It urged 
licensing. They urged standardized training programs and sort of 
licensed departments to offer the degree. There are obviously many 
solutions, but none of them^are entirely satisfactory. Although many 
of them seem quite repugnant, non-solution may also be undesirable. 

•AUDIENCE MEMBER: (Barney Salzberg) 

I am a little concerned. I am recently out of school and I am not In 
a university setting. Frequently, I come In contact with people who 
do behavior modification, or claim to be doing it. On more than one 
occasion, I've been a 1 1 ttle concerned about their lack of procedure. 
I do believe that you have to be concerned for the consumer — to deny 
that fact makes no sense. People who have ne^er had a course in con- 
tingency management claim to be behavior modifiers. I think that's 
fraudulent. Although licensing may not be the way to go, I think we 
must come up with some way to tell the public how to discriminate be- 
tween a genuine behavior modifier and someone who only says he Is. 
It is one thing to disseminate information for somebody to use to ef- 
fect changes in their own liv2S. But, when you expect a person to 
effect changes in somebody else's life, you have encountered a respon 
sibility you cannot avoid. I think it is'time for behavior modifica- 
tion to consider whether licensing the final answer. It may not 
be, but we should have some very firm way of saying, **Yeah, this guy 
meets ten out of the twelve things we think good behavior modifiers 
should do, or training they should have had, or experiences that they 
have undergone." 

• ROBERT HAWKINS: 

We are running short of time, but I would like to suggest that we do 
this kind of thing again In the future. 



Training Behavior Modifiers: A fSimnary and a Proposal 
• DON R. THOMAS 



There are a number of current issues in behavior modification which 
we can no longer afford to ignore* Recently, Psychology Today (No- 
vember, 1972) published an article describing many of the activities 
and programs of behavior modifiers* As the field continues to grow, 
we can no longer dismiss lightly mundane issues such as standardized 
training programs and licensing. The days when it was possible to be 
on a first name basis with all of the behavior modifiers in the coun- 
try no longer exist. No longer is it possible to list all of the be- 
havior modifiers by listing the past s tudeats-ot^ Skinner , Bijou, Baer, 
Michael, Azrin and the rest. No longer is it possible to list behav- 
ior nx)difiers by reference to the university from which they were 
graduated — most of the programs which produced behavior modifiers in 
the 1960*s no longer exist, because their staffs have moved to other 



The panel discussion on training behavior modifiers did not produce 
a consensus of opinion on the next appropriate step; however, it 
clearly raised some important issues* First, there has been a recent 
increase in the number of documented instances in which Incompetent 
individuals have claimed to be behavior modifiers and have conducted 
programs in the name of behavior modification. Second, there is a 
general aversion to the notion of licensing. Rob Hawkins best ex- 
pressed the resulting dilemma when he pointed out that although none 
of us want to be told how to act or how to collect data, all of us 
feel a need to protect ourselves and the public from people with no 
training who claim to be behavior modifiers. 

A variety of partial solutions was recommended. Training programs in 
behavior modification might be accredited. General procedures which 
have been empirically demonstrated to be effective might be certified. 
A professional organization might be formed to generate guidelines. 
Division 25 of the American Psychology Association might begin to ac- 
credit training programs. Finally, it was suggested that we ought to 
continue to talk about the issue. Clearly,^ we can continue to talk 
about the, issue indefinitely. 

I propose that time be allocated during the 1973 Kansas Conference on 
Behavior Analysis in Education to continue the discussic^ of issues 
raised last Spring* But more important, I propose that the objectives 
of the discussion be clearly defined as the development of a profes- 
sional organization whose members are prepared to search actively for 
solutions to the problem. The need to protect ourselves and the public 
Is real. As Jack Michael as^^ed, "Will the REAL behavior modifier 
please stand up?" 
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Behavior analysis of 
drug effects in the classroom 

Stephen L sulzbacher'^ 

The use of pharmacologic agents to modify the behavior of children In 
elementary school classrooms Is currently causing considerable concern 
and controversy among physicians and educators. Although drugs have 
been used as a treatment for learning and behavior disorders for more 
than* thirty years, very little is known about, the exact nature of the 
effects of these drugs on behavior, due largely to the inadequate meth- 
odology which has been employed in studies of drug effects (Sprague and 
Werry, 1971; Mollis and St. Omer, 1972). 

Behavior analysis methodology has been systematically applied to the 
study of drug effects in animals (Sidman, 1956; Thompson and Schuster, 
ly68) , but it has rarely been applied to the analysis of drug effects 
on educationally relevant behaviors of children in the classroom. 
This study presents representative cases illustrating the effects of 
behavior modifying drugs on academic performance and classroom behav- 
ior of elementary school children and presents a methodology for the 
objective assessment of drug-behavior interactions. 

2 

Review of Previous Research 

A literature review was conducted on all studies employing psycho- 
tropic medication with children which were published between January, 
1937, and March, 1971. These studies were categorized on the basis 
of methodology employed and according to the nature of the dependent 
variables studied. A summary of these studies is presented in Table 1, 
which shows that only a very small percentage of the available research 
employed an objective measurement of behavior. It can be seen from the 
data presented In Table 2 that the likelihood of obtaining statistic- 
ally significant results was not related to the type of experimental 
design employed, but was strongly Influenced by the response measure- 
ment technique employed. Table 2 reveals a disturbing inverse rela- 
tionship between degree of rlgorousness of response measurement and 



Department of Pediatrics and Chi Id Development and Mental Retar- 
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2 

This literature review is adapted from an article which will ap- 
pear in Pediatries and should, not be reprinted without permission. 
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TABLE I 

.SUMMARY OF -SURVEYED LITERATURE (1937-1970 



TOTAL NUMBER STUDIES SURVEYED .• • • • ^^59 

STUDIES OF UNRELATED (non-behavioral) 

EFFECTS OF PSYCHOACTIVE DRUGS ' . . -560 

UNAVAILABLE REPORTS 2 H 

TOTAL NUMBER STUDIES OF DRUG EFFECTS 

ON THE BEHAVIOR OF CHILDREN ' 756 

PERCENTAGE OF TOTAL 

NUMBER (n =756) 

UNCONTROLLED STUDIES ^ ' 
(no placebos or double- 
blind). . . -. 54S 72.5 

CONTROLLED STUDIES CATE- 
GORIZED BY DEPENDENT 
VARIABLE: 

a) cLLnicaZ ^p/tei^-con 
or professional opin- 
ion 34 4.5 

b) rating scale 99 13. 1 

c) standard psychologi- 
cal tests 46 6.1 

d) direct measurement of 

behavior 29 3.S 

756 100.0 



the finding of significant, differences in results. Significant dif- 
ferences iniH' mating a favorable drug effect are found in an overwhelm- 
ing majority of the studies employing "professional opinion" or rating 
scales as the dependent variable, but such results are considerably 
less likely to be found when standardized psychological tests or di- 
rect measurements of behavior are employed. 

As will be seen in the following study, drugs 'do in fact exert power- 
ful effects on human behavior, some of which are quite beneficial; but, 
these vary greatly among individuals and it will be shown that contin- 
uous and direct measurement of educationally relevant behaviors in in- 
dividual subjects provides more meaningful data on drug effects in 
children than is currently available with other measures." 



39 



TABLE 2 

ANALYSIS OF STUDIES BY TYPE OF DESIGN, MEASUREMENT 
TECHNIQUE AND SIGNIFICANCE OF RESULT 

SIGNIFICANT DIFFERENCE RESULTS NOT SIGNIFICANT 
FAVORING THE DRUG OR FAVORING PLACEBO 



Within- Between- 
Subjects Groups 
Desian Desian 
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TEST OF ASSOCIATION BETWEEN SIGNIFICANCE 
OF RESULTS AND MEASUREMENT TECHNIQUE EMPLOYED 



SIGNIFICANT 
DIFFERENCE 
(a) 



NO SIGNIFICANT 
DIFFERENCE 



©DIRECT MEASURE.... 12 17 



(n) 
29 



k( l-k) 



©PSYCHOLOGICAL 
TEST 



3S 



46 



k - ^ 



©RATING SCALE 56 43 99 

©OPINION 30 4 34 



ytr = 42.716 

df = 3; p<O.0O000l 



A" = 106 



102 N = 20S 
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METHOD 



Subjects 1^ 

Data from three subjects will be reported. Ralph was seven years, 
eleven months at the beginning. of the drug study, had a full-scale 
Wechsler Intelligence Scale for Children (WISC) intelligence quotient 
of 81, and had been previously diagnosed as autistic and minimally 
brain damaged. Joe was eight years, five months old at the beginning 
of the study, had achieved a full-scale WISC I .Q. of 60 when tested 
without medication prior to the study, and a score of 71 on the same 
test on medication after the study. He had previously been diagnosed 
as emotionally disturbed, dyslexic, and minimally brain damaged. 
Gordon was seven years, eight months old at the beginning of the study, 
had a full-scale WISC I .Q. of lOA and had been diagnosed as hyperactive 
and learning disabled* 

All three boys came from fairly stable homes and attended Special Edu- 
cation classes in public schools in the Seattle area. The drua stud- 
ies with Ralph and Joe were conducted while they attended a special 
summer classroom as part of a research project at the Uni vers i ty. The 
study with Gordon was done in a public school class for children with 
learni ng disabi li ties. 

Because of the imprecis ion of the diagnostic categories of minimal 
brain dysfunction and hyperactivity, the decision to treat these par- 
ticular children with stimulant medication was essentially judgemental. 
The judgements were based on clinical opinion that the child was over- 
active or inattentive in the classroom setting and that he was not 
learning at the rate of his peers. At the present state of knowledge, 
the only reliable way to predixt which child will respond favorably to 
stimulant medication is to observe his behavior on and off the drug 
(Sprague and Werry, 1971). 



Drug Protocol 

The medications employed in the present study were dextro-amphetamine 
sulfate (Dexedrine'') and methylphenidate (Ritalin^). Dosages used 
were between 5 mg. and 20 mg. These drugs are central nervous system 
(CNS) stimulants, and aj^ough there are a number of theories about 
how they act, ^^e^jMseCtse mode of action in humans is still unclear. 

Of the, three general classes of drugs currently prescribed for behav- 
ior problems--CNS stimulants, sedative-hypnotics, and ant i -convulsants- 
the CNS stimulants have certain methodological advantages. Whereas 
some of the other drugs remain active in the body for at least a week, 
CNS stimulants are almost completely (70%) metabolized within 2k hours. 
The use of these drugs as independent variables makes it possible to 
manipulate dosage level on a day-to-day basis. In each case, at least 
two different dosage levels are used as well as a placebo condition. 



Experimental Design 



The basic ABA reversal design with multiple replications was employed 
in all studies. Drugs are uniquely suited as independent variables 
with this type of design since they can be imposed and withdrawn at will 
Each study takes about a month (about 20 school days) yielding 5-6 days 
of data under each drug condition. A random number tab 1^ was employed 
to assign one of the three drug conditions to each of the 20 school days 
An example of a random reversal drug schedule is shown in Table 3. 
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^Weekend days. 



A triple-blind procedure was employed in which neither the subjects, 
the prescribing physician nor anyone taking data was aware of the^ dos- 
age level being administered on any given day. The medication was 
given to the parents In small envelopes, each datedand containing one 
day^s medication* The same number of tablets was In each envelope. 
The parents were unable to distinguish drug tablets^from placebos, 
since the placebos supplied by the drug manufacturers {Ciba-Gelgy Cor- 
poration and Smith, Kline and French Laboratories) were identical In 
appearance with the active tablets. Each child was given the contents 
of his envelope in the morning be fore comit^g to school and the parents 
were instructed to date and return the empty envelopes at the end of 
the study* 



Classroom Conditions ^ — ' . , 

The experimental classroom was about one .tourlh ' the size of classrooms 
customarily seen In the public schools, but was equipped with a one- 
way otser V'3t ion window and microphones. The adjoining obo*?fvat ipn 
booth v.^aF, used for deta-gathef-i ng and to enable parents to /atch the 
classroom procedures.. Anothe"r small room adjoining the classroom was 
used for. Individual tutoring 'sessions, 

TR^cTass met four days a week for six weeks, eac. session lasting 
from 9 a.m. untM noon. The total class enrol Imer.. was six, two of 
whom were Included In the present drug evaluation study. When a child 
arrived at his desk in the morning, he found a file folder containing 
his daily assignments and a sheet of paper listing exactly what work 
JVe had to complete that day. The children were told that all the work 
in tht dally folder had to be completed correctly before they would be 
permitted to leave. The sciiool work was Individually prescribed ac- 
cording to the child's academic needs. Although there were only one 
or two teachers in the classroom at any given time, a total of five 
teachers were Involved In the study, and this. team carefully analyzed 
each chlld*s dally work so that assignments were based on a careful 
analysis of performance and errors on his-prevlous work. All of the 
academic work was either with Individually prepared teaching programs 
or commercially available programmed textbooks Al 1 of the work was 
timed and rate per minute of errors and correct responses were com- 
puted for each subject each day. 

The children were told that when they completed their work they would 
be allowed free time to play outside or with toys available in an ad- 
joining playroom. They also received marks In a small poinUbook fo- 
staying in their seats and not talking during class time. These mc rUs 
were redeemable for money or special ' treats and the boys were also 
allowed to earn extra marks by doing extra schoolwork instead of pJay- 
ing when they had completed their daily assignments. 
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From the chMd^s point of view, the classroom management procedures 
were quite simple: he was required to complete a fixed amount of 
work each day and correct? all of his errors. When this work was com- 
pleted, he would be allowed to play or go home. Each child knew he 
would be taken from the classroom daily to participate In ather exper- 
iments in another room and could earn marks during these sessions. 

The case of Gordon is presented to demonstrate that comparable data 
to that obtained in the expej^imenta 1 classroom situation could be 
gathered by a public school teacher under the conditions prevailing 
in a Special Education class. Gordon^s case is included in the pres- 
ent report to illustrate that meaningful drug dosage decisions can be 
made on the basis of public school classroom data, even though one 
must be satisfied with a~smaller quantity of information gathered un- 
der less clearly defined conditions. 

Reliability 

No reliability scores were computed for any of these data, since there 
was only one person observing at a time in the experimental classroom 
and since the public school-teacher recorded all her own data. * The 
principal investigator reviewed all the programmed academic materials 
which were scored as part of the study and found no points of disagree 
ment with the scoring of correctness of the individual responses. 

Prior to each drug study, the principal Investigator made Joint train- 
ing observations of the target behaviors of thej Individual children 
with the teachers who would subsequently record the data. In the case 
of each ob:erver, a criterion agreement of 90% was reached after two 
20-minute training periods. The data from these observations were, of 
course, not used in ^he study. 

Whereas the absolute relyibility of these data cannot be demonstrated 
or even Inferred, severalMactors provide some support for the assump- 
tion that there was no systematic bias relative to the drug conditions 

1^ Since drug conditions were randomly assigned to success- 
ive days, any change In accuracy of recording over time 
would affect all drug treatment conditions equally. 

2|^ All the teachers observed for equivalent amounts of time 
each day to insure against the possibility that a given 
teacher's observations would fall during any one treatment 
condition more- than any other. 

3^A11 observers were unaware of the drug schedule and did 
not know which child had drug or placebo any given day; 
since they did not know whether a child had received ac- 
tive or placebo medication, any errors of observation were 
assumed to occur with the same likelihood under the differ- 
ent treatment conditions. 



Dependent Variables 

nultiple baseline procedure was used, with measurement of behavioral 
dnd academic target behaviors. It was important that the behaviors 
being measured with each child Include both acceleration and deceler- 
ation targets, since a decrease In both of these classes of measured 
response would indicate sedation (overdose), an undeslred side effect. 

Correct and error rates were obtained using programmed arithmetic texts. 
Reading and writing performances were from carefully prepared compar^ 
able caily tasks In workbooks or oral recitation. - 

Talking out in class was recorded for all three subjects of the present 
study. In addition, rate of getting out of seat during class time was 
computed from data taken In the observation booth in the experimental 
classroom on the two boys who were studied there. Out-of-seat was de- 
fined as air between the chair seat and the child's buttocks or leg 
(the child could be In seat with a leg folded under him)* Each occur- 
rence of out-of-sea. was terminated only when he returnee! to his chair. 
A talk-out was any vocalization which wasn't solicited by the teacher. 
This definition Included grunts, humming, and audible talking to self. 
An Incident of talking out was terminated by someone else interjecting 
a comment to the child or by a silent pause of two or more seconds* 



RESULTS 

Case Study I 

Correct and error rates were kept on Ralph's performances In three aca- 
demic subjects. His daily arithmetic assignments were from the Rainier 
Math Program (Edmark, 1972). All of the assignments were computation 
facts Involving no numbers with more than two digits and Included addi- 
tion with carrying, and subtraction without borrowing problems. Oral 
reading rate was obtained from Around the Corner (Ginn, 1966). After 
he completed the reading task, Ralph had to make written responses to 
comprehension questions about the story he h d just read. 

Ralph was^ exposed to three drug conditions: placebo^ 5 mg. and 10 mg. 
dextroamphetamine. The following data are means of nine placebo days, 
seven 5 mg. days and six ICf mg. days, which occurred in random order 
during the study. His frequencies of talking out and of getting out of 
his seat during class are plotted for each drug condition In Figure 1. 

Both of these behaviors showed a marked reduction on days when active 
medication had been administered. Chi-Square analyses confirmed the 
statistical significance of these differences (p<0.01). 

Drug effects on Ralph's academic performances are displayed in Figure 2. 
His arithmetic performance rate was more than doubled under the drug con- 



ditions, while errors remained unaffected. However," both language arts 
behaviors showed a non-linear dose-effect relationship, with performance 
rates under 10 mg* being lower than In the placebo condition. 
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Effects of d-amphetami ne on Ralph^s 



classroom behavior* The heavy lines connect 
the means of each condition* The light bars 
around each mean indicate the range of daily 
rates* 



46 




Fig, 2, Effects of d-amphetami ne on the aca- 
demic performance of Ralph. 



Case Study II 

Joe's curriculum consisted of written number chaining and beginning 
addition facts from the Rainier Math Program, assignments^ from a pro- 
grammed writing text. Handwriting with Write and See (Skinner and Kra- 
kower, 1968), 'and a beginning phonics reading program devised by the 
present investigator which consisted of discrimination tasks between 
vowels, consonants, and phonetic letter combinations. 



A7 

There were seven'school days on which Joe received 10 mg. of dextro- 
amphetamine, sixldays on which he received 5 mg. and six days on which 
he received placebos. The unequal number-^ of days under the three con- 
ditions was due to Joe's absence from school on two days. The mean 
frequencies of two disruptive bfehaViors under each drug condition are- 
shown in Figu.re 3. 
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There were highly significant decrements of both talking out and get- 
ting out of seat on the days Joe received active medication (p<0,01)* 
The effects of medication on Joe's academic performance are shown in 
Figure The total performance rate in arithmetic and reading is 
slightly increased under the S nig« condition; the performance Increase 
can be seen to result almost entirely from Increases in the error rate, 
Joe's writing rate, however, shows an Increment at*5 mg* and a further 
Increment at mg,, with little concomitant Increase In error rate, 

16 - 
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Fig, 4, Joe's academic performance rates 
under placebo and two dosages of d-ampheta- 
mi ne. 



Case Study III 
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Data were obtained on Gordo 
public school classroom 
of placebo, six days with 0 



behavior for twenty school days in his 
^ere five days of baseline, four days 
rg. o¥ methyl pheni date and five days with 




15 mg. The teacher in Gordon's class for children wi th- learni ng dis- 
abilities gathered ciata on reading and on talking out in class; The 
reading tasks consisted of daily assignments in the workbook which ac- 
companies On Cherry JSireet (Ginn, 196,6). Each incident of speaking 
or vocalizing without being asked to was recorded by the teacher on a 
golf-stroke counter which she wore on her wrist. 



Talking out 
in class 




Talking out at 
the dinner table 
at home 
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Fig» 5. Effects of methyl pheni date on 
Gorcton^s talking behavior* 
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The mother^s complaint at home was that Gordon frequently interrupted 
other people in the household and that this was particularly prevalent 
and annoying during dinnertime conversations. The mother recorded all 
incidents of talking, whether appropriate or not, at the dinner table 
and also noted the time dinner began an.d ended so that rates could be 
computed. 

A summary of Gordon's responses under the various drug conditions is 
shown in Figure 5* A fairly clear-cut change in Gordon's talk-out rate 
is apparent between baseline and all other conditions (p<0.01), sug- 
gesting a placebo effect rather than a change due to the actual drug. 

Gordon's rate of talking at the dinner table at home was apparently un- 
affected by the medication. In Figure 6, his language arts performance 
rate does not appear to show any systematic effect of medication, where- 
as the error rate showed a non-significant placebo effect. With addi- 
tional redaction in error rate as successively higher drug dosages. 



UnguaoAArts Workbook AttionnwnU 



60 



Fig. 6. Effects* of methyl- 
phenidate on Gordon's lang- 
uage arts performance. 
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SUMMARY 

Three' cases were presented wh ich systematically replicated procedures 
for assessing, in public school classrooms, the effects of psychotropic 
drugs on learning and behavior. In each case, different behaviors were 
shown to be affected by the medication, illustrating the degree of in- 
dividual differences in drug response. 

The assessment of drug effects in the classroom appears to be a problem 
which, due to our present state, of knowledge of pharmacology, can only 
be solved through the use of single subject studies of individual drug 
responses on thi educationally relevant behaviors which led to the child* 
being referred for treatment. The cases presented indicate that central 
nervous system stimulant medication can effectively modify disruptive 
behaviors without adversely affecting academic performance in the class- 
room. This is not to suggest, however, that other behavior modification 
procedures would not be equally effective in some cases. 



/ 
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The effect of 
general 8t descriptive reinforcement^ 
on ^creativity' in easel painting^ 

elizabeth m. goetz^ 
mary m. salmonson 

I 

Early childhood educators have traditionally paid Up service to the 
development of creativity even though It Is their appropriate concern 
(Evans, 1971)* Perhaps research has not concre^tely presented to edu- 
cators methods for the cultivation of creativity. 

Creativity Is a difficult concept to define objectively. Definitions 
of the concept have been used In. reference to such diverse areas as 
the mental processes and 3bi 1 Ities, personality, products, verbal be- 
havior and physical behavior , (Torrance, 1965) • Only the products and 
verbal and physical behaviors lend themselves to objective measurement 
in that they may be analyzed as to the specific novel forms they con- 
tain. A key criterion for creativity is originality, difference or 
novelty. 

Goetz and Baer (1970 Indicated that It was possible to Increase diver-' 
sity of blockbui Idlng In preschool children by reinforcing the use of 
new block forms for each child. The present study continued the inves' 
tigation into this aspect of creativity by using a new medium — easel 
painting, and also studied specific types of teacher attention that may 
be related to an increase in creative behavior. 



METHOD 

Subjects 

Three preschool children from the Edna A. Hill Child Development Pre- 
school Laboratories were selected for this study. All three were 
selected due to a fairly Vow number of different forms used In their 
easel paintings. 
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The subjects (Sue, Carrie, and Jane — pseudonyms for purposes of report- 
ing) were invited to paint at the preschool easel 'by the teacher-exper- 
imenter. Three different color cups (red, blue, and yellow) with a 1/2" 
brush in each were always available. Tlie same size paper (18". x 20") 
was always used. The children determined the length of each easel paint- 
ing session by stopping when they felt their pictures were completed, 
and at this time the experimenter thanked the subject for painting. 

The experimenter defined 25 pointing forms from many children's pictures 
prior to the beginning of the study (Table 1). Some of the forms were 
curve, mass, spatter, zig-zag, and triangle. Reliability on these forms 
was found to' be possible." 

Teacher attention delivered contingently on each new form as it was 
painted was defined by two categories: 

[T] GENERAL REINFORCEMENT - A painting form was ac- 
knowledged as being "good" but no specific as- 
pect was singled out for comment. For example, 
general reinforcement took the form of such 
phrases as, "lsn*t that nice," or "See what you 
have here," when the child painted different 
forms. 

(13 DESCRIPTIVE REINFORCEMENT - The teacher's com- 
ments were directed toward a specific form de- 
scribing it. Such comments as, "That is a very 
straight horizontal line you have painted," or 
"Now you are dping a zig-zag back and forth," 
are examples of descriptive reinforcement. 

A third condition of-no-teacher attention was also used. The child 
simply painted while the teacher v^atched, but made no comments on the 
ch i Id* s paint ing. 

Each child was run in an individual analysis design and therefore served 
as her own control across various conditions. In addition, each child- 
was run in a different sequence of conditions so that the effects of 
each condition in a different order could be studied. The design for 
Sue-was: -A8C8C; for Carrie: A8CAC; and for Jana: ACAC (where A = W<? 
^zln{^on.tzmQ.nt; B = Gmo^nal RoXnf^o/LCZrmnt) and C ^ Pe^cAxptiue.^ein^o^tce- 
mCKii) . 

Reliability checks were taken by an independent observer on painting 
forms, teacher attention and duration of painting during each condition 
for each subject . 



TABLE I 



DEFINITIONS OF PAINTING FORMS 



The horizontal^ vertical^ and diagonal lines ave defined 
by angles relative to the bottom of the paper , using the 
smallest angle as a measurement. 

!• BLENDED COLOR - any hue formed by mixing two or more 
pure or available colors onto the paper* 

^2* CIRCULAR - any nearly enclosed curve such as circles, 
ovals , el 1 ipses » etc. 

3- CURVE - a line or any -part^of a line, at least 3** 
long, continuously bent so that no portion of it is 
s t ra i gh t . 

4. DIAGONAL LINE - a relatively straight line, at least 
3'* long, forming a 10° - 80° angle. , 

5. DUPLICATE FORM - a relatively exact paiT^oT any ab- 
stract form, clearly seen as 3 design, or any of the 
starred forms: The size and color may vary but not 
the structure. It should be basically the same. 
Simple forms, such as circles, require more exactness 
than more complex forms, such as an i rregulaF^enclo- 
sure or a simulation. A staccato grouping itself is 
not a duplicate. The same grouping must be repeated 
in another area of the paper. 

6. ' HORIZONTAL LINE - a relatively straight line, at least 

3*' long, forming a O"" - 10"" angle. 

^7. IR REGULAR ENCLOSURE > any closed or nearly closed un- 
SI wetriaal line formation. 

^8. LAYERED - three or more repeated lines, using two or 
more different colors, one inch or less in width, 
which lie side by side. Each line should be a dif- 
ferent color than the one(s) directly beside it. 

9. MASS - any nearly solid painted area at least 2'* 
long and 2^^ wide. 



10. 



OVERLAPPING SAME FORMS - a dupHcate with one form 
extending over and covering a pa7t of the other. 
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II. PATTERN - same as n duplicate, only requires three 
or more copies . 

*I2. RECTANGULAR - ^ny nearly enclosed form with four 
relatively straight sides and four 90° angles, 
approximate within 10°. Opposite sides must be 
relatively paral lei . 

^^13. S IMULATION - a construction which resembles a real- 
life object. Symbols, such as letters and numbers, 
are n* t simulations . 

14. SPATTER - three or more scattered or dashed small 
particles or drops resulting from one swing cf the 
brush. 

15. SPIRAL - a winding or coiled l^e; ^ « |9[ 
whether consisting of a continuous ^ 
curve o* straight lines. There must be at least two 
complete revolutions. 

16. STACCATO - three or more quick dabs that are ndt the 
result of a spatter 'and are clustered in the same 
area. They may or may notjbe overlapping. 

^17. SYMBOL - something other than a simulation which 
stands^ for something else, such as signs, letters 
and^mjmbers. ] 

*I8. * TINKER TOY LINE - circular forms with ^^-^ 

one or more straight ' lines connecting -Lx'*''^ 
them. 

^^19. TRAIN OF COLORS - a series (three or more) of two 
or more colors forming a line or procession. 

20. TRIANGULAR - any closed or nearly enclosed form with 
only three sides and three angles. The INSIDE lengths 

' of at least two (2) sides must be at least 1 1/2''. 

21 . TRICKLE - a flowing or fal 1 i ng drop in a smal 1 , bro- 
ken or gentle strear.. 



22. UNDULATING LiNE - a line with three 
.or more curves approximately or 
greater in <tepth . 
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23. VERTICAL LINE - a relatively straight line, at least 
3" long, forming an 80° - 100° angle. 
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24. X-SHAPE OR CROSS - two i nterest i ng s trai ght lines of 
linear proportions not greater than two^to^one (2:1). 
the two portion of an intersected line must be in 
prcoortions no greater than two-to-one (2:1), also* 
Examples : i-i 



1. If the lines are of relatively EQUAL LENGTH, 
the angle of intersection is arbitrary, but 
the lines must intersect at relatJ^vely the 
same point on each line. Examples: 

xi-x 

2. If the lines are riot of equal length, the an 
^- gle of intersection must be relatively close 

to 90° (+ or - 10°). Examples: 



25. ZIG-ZAG LINE - a line or any part of a line with three 
or more angles formed by turning first to one side and ^ 
then to the other. 




RESULTS ^ ' 

The results of the^three- subjects were similar under the same condi- 
tions regardless of the o^der they appeared. It is important to note 
that the painting times which ranged from approximately four minutes 
to under one minute had a slight tendency to become shorter across the 
twenty (or twenty-three) sessions of the study for all subjects (Fig- 
ure 1 ) . 

Sue (top graph of Figure 2) had an average of 7.67 different forms 
under no reinforcement (baseline) condition across the three sessions. 
When general reinforcement was started on the fourth session, the av- 
erage number of forms did not increase over BaseHne. However, the 
two conditions of descriptive teacher attention (interspersed with 
another general teacher attention) did show an increase in number of 
different forms used. 

Carrie (middle graph of Figure 2)^also showed the highest number of ~ 
different forms used when descriptive attention was used. 

Jane (lower graph) showed^ a sUght increase ao ro s s- ba sej-t.tie conditions 
(first and third conditions) but when descriptive reinforcement fol- 
lowed it was always higher than baseli >e (second and foUrth conditions) 

For all three subjects, descriptive praise resulted in an increment in 
form diversity. For two of the subjects, that had the comparison, de- 
scriptive praise resulted in higher form diversity scores. 
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.Fig* L The durations, of time spent In each individ- 
ual painting for three children ih""the course of easel* 
painting training*., Ini^-ial points, labeled N's, rep- . 
resent baseline durations under con'dit ions 'of no rein- 
forcement; points labeled as G's represent durations 
under conditions of general reinforcement contingent 
-on each new form drawn in a single painting; and poi.nts' 
labeled as D's represent durations under conditions of 
descriptive reinforcement contingent on each new form 
drawn i n a si ngle pai nti ng* 
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Fig. 2. The form diversity scores of three children in the course of 
easel painting training. Initial points labeled as N's represent base- 
line observations under conditions of no reinforcement; points labeled 
6's represent scores produced when general reinforcement was contingent 
on each naw^form drawn in a si'ngle painting; and points labeled as DLs. ] 
represent scores produced when descriptive reinforcement was^cont i ngent 
on each new form drawn in a single painting. 
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Reliability scores on identi f icat io1) of painting forms, type of teach- 
er reinforcements used and duration of painting were ninety-nine percent 
or higher. * 



DISCUSSION 

This research suggests that a teacher can, through the type of attention 
he gives, increase the tAOJitive. ci6pzct6 (form diversity) for children. 
The use of descriptive praise is the most effective and necessitates 
that the teacher study different forms children make so that he can iden- 
tify them and respond specifically to them. Further, teachers must in- 
dividually score children*s easel paintings so that he may differentially 
respond to children's use of hew forms. The results also tend to ques- 
tion whether or, not just giving chi Idren J'|)r^ctice" in easel painting, 
without feedback, will help develop creative behaviors. 

Further research is needed to differentiate, the effects of general and 
descriptive praise not only in easel painting but In the many creative 
activities in which children engage. 
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Freedom & responsibility 
in an elementary school 

Charles L salxberg 

,Frleedom^annot exist Jong in a school unless it. is 
accompanied by^ responsible behavior. This study 
attempted to develop and^maintain responsible be- 
havior in two groups of elemenrary school students 
regarding their mathematics program. When students- 
were allowed to do as little or as much as they 
wished, they did less than one half of a page each 
day. When the freedom to leave class was made con- 
tingent on finishing one page of math their rate of 
work (problems/minute) almost doubled, A procedure 
' " i ch children recorded 1heir own progress in 
r^^l}iv(gtaC.specj 4\ charts-^generated ,much interest but 
Jlfitl^a change in their rates of math progress. A 
"^Wrd_£rocedure in wh]ch students were required to 
pass a qu_L2^ each week in order to leave class early 
almost doubled the rate of work. Studen+s in the ' 
older group were subsequently permitted to elect a 
condition in which they did not have to attend 
class at al I if they passed two quizzes per week."^' 
Sixty percent of the older students elected to tr/ 
this procedure. Their rate of work once again 
doubled. Those students were progressing at four 
times the normative rate^of their public school-age 
peers. With the onset of the last two conditions 
students began to 'take initiative for their own 
academic progress. They began to come ;o class early 
- - - to get a fast start. Students also began to volun- 
tarily take some work home. They were beginning to 
demonstrate behavior that the teachers would call re^ 
sponsible. 

The free school movement is popular^nd if appears to be growing. Like' 
most movements, the free school movement is defined more by what It op- 
poses than by those things that it favors. It grew out of a reaction 
against the oppressive atmosphere of traditional educational practices. 
It continues to grow for these sahie reasons, but also in part because of 
the progressively more public failure of these same traditional school 
procedures. 
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Free school advocates are reacting against authoritarian classrooms in 
which children are maximally isolated from each other in single desks, 
arranged in rows. They are reacting against children spending most of 
their day Jn^a single, often sterile room, usually confined to one chair. 
There is also opposition to the behavioral priorities which exist in 
traditional classrooms such as: not talking, not chewing gum, not di.s- 
agreeing with the teacher, not making noise. When basic skills are 
taught the traditional role for the student is little more than passive- 
ly attending to the -teacher while she runs off her chain of instruction- 
al behaviors. This is neither a very effective nor a pleasant procedure 
for children to endure day after day. 

The-goals of the free school movement then, are to open up the classroom, 
encourage the children to interact with each other and with stimulating 
materials in a rich environment so that they may learn inductively, and 
most important so that they may learn that the learning process itself 
can be a satisfying, enjoyable experience. 

Offering criticism and opposition to a system is one thing. Offering 
practical alternatives is something else again, A large nunter of free 
schools have been started in the recent past. However, the average life 
span of a free school is less than two years. It is not clear' why they 
fail. Free schools are not generally oriented toward measurement and so 
quantitative answers to that question are not forthcoming. Lacking that, 
we would like to relate some of our experiences to y<n!. 

The Colorado Springs Community School was begun in I969 by a group of 
parents as an alternative to the local publ ic^school system. From the 
outset it was developed along the free school model. Children ranged in 
age from 5 to ]k years old. Classes were voluntary for the chrldren. 
Teachers, for the most part, tried to help the children organize activi- 
ties by providing guidance, materials, and explanations when they w'Sre re 
quested. Children had free run of the school and the surrounding ar^a.— 
There were very frequent field trips to local places of interest as well 
as more prolonged trips for camping. Children were not coerced into^par- 
ticipating in any activities. They were encouraged to express their 
thoughts and feelings. Over the course of the year academic work became 
less and less frequent. The best efforts of a dedicated staff with a low 
student- teacher rat io-we re-no t suf f icient *to generate very much skill or- 
iented behavior. Even more discouraging was the development of inconsid- 
erate, rude, and abusive social behavior of the children toward one an- 
other and toward the adults. Children showed little respect for one an- 
other's rights to privacy, to worU undisturbed; to their own property, 
or to be free from physical abuse. • On occasion group meetings were held 
where these issues were discussed. The children would agree tha.t many 
social and property abuses were undesirable for everyone concerned. ^How- 
ever, these verbal statements had no effect on their subsequent actions. 
The school had become a place where nothHtg^nci'nb one was safe from de- 
structioji, even the building itself. Complete freedom from adult con- 
straints had produced an environment where none of the children were free 
even from fear for their own physical well-being. 
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We cannot be sure about the extent to which our experience applies to 
other free schools* However, it would not be surprising if the above 
factors have something to do with why so many free schools fail in a 
short time* 

In planning for the next year the staff and some of tTie parents at the 
Community School began to rethink the issue of freedom wi thi n the school. 
First, it became evident that freedom is not a global entity. In fact, 
there seemed to be innumerable' potential freedoms within a school en- 
vironment* There were the host of freedoms associated with access to 
materials, activities, and areas, both within the school and within the 
community at large* Then there were the more personal freedoms, such as 
the freedom of movement, of speech, of self-expression. There were 
freedoms associated with schedul i ng one* s own activities, in one's own 
time, in a place of one's own choosing* There were also many freedoms 
which could be stated negatively: the freedom to leave a project momen- 
tarily without returning to find it destroyed or miss ing; the freedom to 
pursue a task;wi thout constant disruption; the freedom not to be contin- 
ually abused or intimidated by feltow students as well as by adults* 
The list of potential freedoms seemed boundless. 

S^econd, specific freedoms could be maintained only so long as^they 
were accompanied by associated responsible behaviors* The Community 
School used many resources outside the school. However, when some of 
our children abused those resources we stood in danger of becoming less 

* welcome guest?,* There have been many people who \/olunteered to conduct 
interesting projects at the school* However, when volunteers were verb- 
ally or otherwise abused they were less likely to volunteer their ser- 
vices in the future* When the destruction of property became rarr^ant 
it was no longer possible to give children free access to equipment and 

^materials* Thus, the abusive and destructive behavior of the children 
was eroding the freedoms within the Communi ty School , and it was doing 
it in a way more certain than adult authority could ever do* 

Another consideration was that all the children at the school were los- 
ing freedoms because of the irresponsible behavior of a minority of 
students* Even more frustrating was that the younger children were 
beginning to emulate the most^,aggressive, abusive, authoritarian behav- 
ior of their older peers* It seemed that the adults had relinquished 
their authority to the most aggressive children who were in turn shaping 
all the children to become progressively more insensitive toward each 
-Other* 

The question that came. sharply to focus from these discussions was how 
cculd a school develop and maintain the kind of responsible behaviors 
that would allow freedoms within the school to be maximized for all 
children* In the past we gave our children a school environment with a 
maximum of freedom from adult authority and assumed that their actions 
would rise to meet the occasion* They didn't* The opposite effect oc- 
curred and the result was a hostile, unproductive atmosphere. Therefore 
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we decided to try the opposite strategy. That is, we could award spe- 
cific freedoms to individual children only as they began to demonstrate 
the appropriate responsible behavior* 

Before attempting to put this new strategy to use on a^ school -wi de basis 
we decided to try it first in a more 1 imi-t^d ^vayv -The children had no 
previous systematic instruction In mathematics and their skills in this 
areo were correspondingly limited. Therefore, we decided to examine 
the effect of making math class time available for students to use as 
free time dependent on their maintaining satisfactory rates in the ac- 
quisition of mathematics skills. 

Setting 

The Colorado Springs Community School has ^0 students ranging in age from 
h to. 14. It is located in a reasonably spacious building which has /rough- 
ly ten rooms or areas of varying dimensions and a playgrouhd=a£iE^QJUts ide. 
Children have free access to all areas except during classes^ This study 
took place In the math area which contained five tables. Children were 
free to sit wherever they wanted to in the room. 



Subjects 

Eighteen children, 9 to lA years old, were in the first class which met 
from 9:30 to 10:30 AM, Monday, Tuesday, Thursday, and Friday. Sixteen 
children, ^ to 8 years old, were in the second class which met from 10:30 
to 11:30 AM on the same four days. Ten children in each class who were 
enrolled for the entire school year, and were working in the math program 
described below, served as subjects. Most of these children had no'^sys- 
tematic instruction in mathematics for the previous two years and their 
skill level in this area was relatively low. 

Mater*ials 

The math materials for this study were adapted from Patrick Suppes, Sets 
and Numbers (Books 1-4^ 1962). * The material was .transcribed onto ditto 
sheets, each sheet containing one or two concepts. Every new type of 
problem or new format was defined as a concept. Quizzes *were written for 
each ten concepts directly corresponding to the problems on the worksheets 
The students were required to get, eight out of ten problems correct on 
each quiz before moving on i n the program. Each child was allowed to work 
at his own pace and at his own skill level. There was no group instruc- 
tion in math at any time during the school year. Throughout the entire 
study the children were required to- have their work checked and correct 
any errors before leaving class. The time which the class began and the 
checkout time for each student was recorded each day. 
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EXPERIfOTAL CONDITIONS 
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ONE PAGE PER DAY 
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—I 
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1— 
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-T" 

20 



25 
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Fig, I. The basic research design was a multiple 
baseline across groups. 



Research Design 

The basic design of this study was a multiple baseline across two dif- 
ferent groups of subjects. To provide additional inferential power/ a 
one-week reversal of procedures was included for the older children 
(Group I) in week 19, The sequence of experimental conditions is pre-^ 
sented in Figure K Note that each new condition is added to, and in- 
cludes, the previous conditions. 



Experimental Conditions 

One Page Per Day Minimum , During thi s condi tion students were required 
to come to class and complete a minimum of one page at which time they 
were free to leave, . 

Self-recording Procedure Plus One Page Minimum . Students were provided 
with charts in their math folders. Each time a child passed a quiz he 
colored in the ^propriate block on his chart, as shown in Figure 2, 
During this condition students were still required to complete a page 
of work before leaving class. 
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SELF-RECORDING CHART 



OAVID 



SERIES 0 



N 




WEEKS 



Fig* 2. Self-recording charts as shown here were 
used by the stud^ts to track their rate of progress 
through the math program* 



One Quiz Per Week . During this condition the students were free to leave 
cTass as soon as they completed their one page a day minimum requirement 
and passed at least one quiz each week. If they failed to pass a^ quiz in 
any week they were required to stay in math class for the entire hour dur- 
ing the following week. This included students who were absent. They 
continued to chart their own progress through the math program. 

Two Quizzes Per Week . Students in Group I were told that they did not 
have to attend class at all if they passed one quiz on Tuesday, and another 
on Friday. Students who elected- this system were given a packet of mater- 
ials containing^ ten concepts on Friday which was to be completed in time 
to take a quiz on Tuesday morning. If the Tuesday quiz was passed, they 
received the next packet of materials which was due on Friday morning. 
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They could, If they wished, come to class to receive instruction or ask 
questions. The only requirement in addition to passing the two quizzes 
a week was that they not disturb other stifdeTits" who were working in class 
This condition was- offered for two weeks to Group I only. 

No Minimum Requirement * This condition was run for Group II students 
only during the fi rst three weeks of the school year (prior*to Session 1, 
Figure !)• In this condition students had to come to class but they 
could do as little or as much as they cared to and leave as soon as they 
desired. 

Que.stionnaire 

Because the time necessary to conduct ^ac.tuaJ^^eferehce experiments was 
lacking, a questionnaire was administered to both groups of students re- 
garding their preferences for the various exp^Ftmental conditions. The 
older children did the questionnaire independently. Since many of the , 
younger children lacked the reading and writing skills necessary to fill 
it out by themselves the questionnaire was~ administered to them individ- 
ually by an adult volunteer. 



Reliability 

The primary behaviors measured in this study, rate of passing quizzes 
and number of pages of work completed, both leave permanent records. 
The scoring of quizzes was checked by an independent observer who was 
not aware of the experimental conditions from which the quizzes came. 
One out of five quizzes was checked in this fashion for each phase of 
the experiment. The mean rel iabi 1 i ty was Sl% agreement with a range of 
90% to 100%. Percent agreement was calculated as agreements times 100 
divided by agreements plus disagreements. 

RESULTS 

Figure 3 presents the total number of quizzes passed each week in both 
groups in all the experimental conditions. Each group had , ten students. 
During the one page per day minimum condition both .groups averaged 
about five quizzes passed each week. That is, it took a student ap- 
proximately two weeks to complete a ten concept unit of^work and pass 
the assocfiated quiz. 

During the next condition the students were introduced to the self-re-* 
cording charts. Although they were interested in them and usually eager 
to mark in the appropriate block when they passed a qujz, their r^te of 
progress- in the matK program remained basically unchanged. 
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SUCCESSIVE WEEKS 

Fig. 3. The mean number of quizzes passed each' 
week of school for Group I and Group II in aU 
the 3bove conditions. 



There was an immediate and~sharp increase in the rate of progress in 
both groups during the one quiz per week condition. The Group I stu- 
dents rncreased from a mean of 6.0 quizzes passed per week to a-' mean 
of 9.7. Group II students increased from k.O to almost 8.0 quizzes 
passed per week. 

When the conditions were reversed for one week back to the one page per 
day procedure, Group I students returned to a rate even lower than their 
previous baseline rate. When the one quiz per week procedure was rein- 
stated the rate of passing quizzes rose again to about its former rate 
during that condition. 

When the two quizzes per week condition was begun for G^up I, six stu- 
dents elected this procedure immediately. They received their packets 
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Friday, and five of the six students successfully completed their work 
and passed the Tuesday quiz. Only one of these five students, however, 
'finished his Tuesday assignment on time and passed- the quiz on Friday. 
The one successful student' and one other student who had not previously 
elected this condition were eligible, and elected the two quiz per week 
procedure that Friday Both s'-jdents successfully completed the Tuesday 
and Friday assignments and passed the appropriate quizzes. On the second 
Friday, four students were*el igible and elected the two quiz per week con- 
ditl-on for the fol lowing week, Since this was the last academic week of 
the school year, the contingency which always applled^to the subsequent 
week was no longer in effect,. Consequently, the data from this final 
week were not Included In^ the study. — i - „ ^ 

DuK^ng the first 'three weeks of the school year the younger children 
were allowed to do as lljttle or ^as .much math as they wan t^id to and could 

:.leavf- class as soon^as they wished,. It^may be seen^from Figure k that, 
under the no requirement 'condition they did very little, an average of 

,six problems each day, ^They were working at an iverage rate of Je9«.. than 
one ha^lf problem per minute, and spending about !5 minutes In class each 
day. When in^the next condition they were required, to complete a mini- 
mum of one page each day before leaving class,, they completed two and one 
half to tfhrjee times as many problems. The upi^^r axis in Figure ^^indi- 
cates that their rate of work also Increased- Consequently , even though 
tbf.y were completing 'two and one half to three* times the previous amount 
of wo^k, they were only spendinf, jn additional five to seven minutes in 
class, ' ^ 

There were some correlated effects' oC the experimental procedures In 
.addition to Incre^sJng the students* rates of 'progress *^i n math. At the 
beginning of the*^ school year It was necessary to round the children up 
for class each morning,' During the one qui z per' week condition students 
began showing' up Ifi class early to do' their math. In fact, an average 
of 31% of the Group I students came to class early each day -during the 
-one quiz per week condition. No student ever xame to class early in any.. 
of the previous experimental ponditior !n the beginning of the school 
year no student ever' voluntarily took -anv academic work to do at home. 
Figure 5 shows* the total number or pagei the Group I students voluntarily 
did outside the math class each week. During the sel f-recording condjT 
tion two students occasionally took a page or two home and -returned it' 
completed. Three weeks Into the one quiz per week condition, significant 
numbers of students began^ to take work heme. This effect continued until 
the experimental conditions were reversed, when voluntary homework de- 
creased to zero. When the one. quiz pe\ week condition was reinstated voH 
unta'7 homework again Increased, 

The mean number of pa'ges of work per day that eAth student completed in 
the last ten days of a1 1 exper tmenta i conditions is shown In Table 1. It 
may be noted that Student C i^ Group I did not respond to Ihe experimental 
contlngencTes, All other stud^pnts were Influenced in varying de.grees by 
the- free tlnct contingency, '| ' = 



Fig* 4.- -The mean rate and number of prob- 
I ems completed by Group II students duri ng 
the last ten days in each of^ the -above cori- 
*ditions, , 
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Fig^^ The total -number of pages of vol- 
untary homework completed by Gr^oup I stu- 
dents each week in all experimental condi- 
tions. 
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The rnean number of pages per day of math com- 
pleted by each student during the -last 10 days ^ 
Mn each e?<perimenta I condition. The asterisks 
indicate the number of times each student in 
Group I successfully completed the qu i z - per 
one half week criteria needed to stay eligible 
for the two quizzes per week condition. 



The-resul ts of the questionnaire iare piesentedin Figure 6. When the 
older children chose between the two quiz-per week condition and the one 
quiz per week condition, stven of the nine preferred to do more work and 
not go to class at all. These were the same seven children who had ac- 
tually attempted (though not always successfully) that procedure. Of 
.the two older chi Idreh who generally preferred the less work, less free 
time condition, one was the* student/ for whom' the free time contingency 
had no effect. The younger students, on the upper axis, had never had 
the .opportunl ty to-e4ect the two quiz per week condition and their stated 
preferences regarding that differ from those of Group I. The last two 
preference comparisons Indicate that there Is a strong stated preference^ 
to meet relatively* high work criteria when the alternative Is to^be In 
class the entire hour even without any mi nimum work requirements. 
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Fig. 6." The results from .the quest ionnai re given to' Group 
md (Jroup II students at the end* of the school year. * 
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DISCUSS I ON^ _ 

The effects of the experimental procedures in this study were certainly 
desirable from a teacher's point of view. During the one page minimum 
requirement the students* rates of progress would allow them to complete 
about one normative year's work in one year. Their rates of work during 
the one quiz per week condi t ion would allow them to. cover two normal 
years of math training in one year. Students successfully meeting the 
two quizzes per week contingency were working at a rate three and '^ne 
half to four times that of their normative peers. Correlated inCfc:ases 
in self-help behaviors and increases in voluntary homework and pro'^'^t- 
ness in coming to class produced a more^ pleasant , cooperative .i.nst ac- 
tional Climate'. ' ^ . ' ' - 

The experimental procedures-produced increases in the rate of progress 
-for 19 out of 20 students. *Most students spent their earned free time 
social i zing wiTfT each other. The one student for whom the' procedures 
•were not effective had a IcTng histor/ of .aversi ve social interactions 
with the other chf-ldren at the school. This itiay be related to the inef- 
fectiveness oY the free time rein^orcer for this child. One could allow 
children to speci fy^al ternate reinforcers. One could also attempt to op 
erate directly on this child's social, interaction. 

In addition to examining "he effect of the experimental procedures on th 
rate of work, it also seemed desirable to develop classroan procedures 
which would take into account the preferences of the children. The re- 
sults of the^questionnai re^ presented in Figure 6 indicated for most chil 
Jren^a/^rS^tated preference for high work loais if these are matched by in- 
creas^rng opportunities for free time! 

These data refer primarily to academic behavior. Hot^ever, creating a 
situation In which it was In the direct interest of each student to .pro- 
gress through the math program also produced a wide variety of self-help 
behavfors; from procuring one's own pencils and materials to taking some 
work to do at home. Unfortunately we lacked facilities to objectively 
measure all these additional effects. The teachers would sum* it up by 
saying that the students were beginning to take initiiative for their own 
academic .progress . - 

The strategy of awarding f|-eedoms contingent upon associated responsible 
behaviors is applicable to social as well as academic areas.*. We are ^In 
the process of developing some mechanisms to try it out on a school -wide 
basis. It seems that this strcitegy has three advantages. First, it in- 
su^-ec , maximum prerogatives to those children whose behavior merits them, 
f'ijcond, it protects the freedoms of those who have earned them from beinc 
i:ndangered by the behavior of those thildren who have been characteris- 
tically abusive. Most important, th|s strategy Uas the potential of mov- 
ing all the children toward being the kind of thoughtful >rodijctiye, in- 
dependent individuals whom we v^ry much want to encoura^*^. 



JHose who are interested yh conducting free schools will come, in time, 
to recognize, as we did, that} there is more to the creation of a free 
environment than removing ^diiilt supervision. Freedom can exist in a 
school only to the extent that the students in that school are respon- 
sible. The potent i a l_fre^edoms available within a school can produce 
and maintain that responsible behavior but only when access to those 
f reedon > is made contingent upon that responsible behavior. 
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AcHIEVEMEk'T teSTS VS. 
DIRECT & DAILY MEASUREMENT^ 

marie d. eaton 
torn c. Imfitt 



In September or May many children in elenientary schools throughout the 
country are given achievement tests. The score's from these tests are 
used for three major purposes: placement^ eomrunieation and evdlvjxtion. 
In this paper the use of achievement test scores for these purposes 
will be challenged* Direct and daily measurement wi ] L be. offered as 
an alternative method of assessing performance* 



Placement 

Achievement test scores are of-fceo-used to-p^lace children in one class 
or another (e*g. , second or third).; in one-rieading grade level or" an- 
other (e.g., 2-2 or for example, a pupil's subtes/t scores 
at the beginning of ^the.year on an achievement test are second grade- 
six months (2.6), he could be placed in a reader that supposedly cor- 
responds to the second half of the second yVar (2-2). ~ 

'Such a placement could, for a number of reasons, be highly^ inapproprr- 
ate* One factor^ that might account for the mismatch between the pupil 
• and program^could be that the achievement test was given onJ;y-ohce. 
It could be that the child vyas a very fortunate guesser on the day of 
the test and received a score much higher than hFs true ability. Con- 
versely, the pupil may have been ill or upset on the day of testing and 
obtained a score far below his real competence. 

A second factor that could account for an incongruous union between pu-* 
pii and program is that the achievement test sampled one set of behav- 
iors and the teacher and her reading program stressed another sef^of 
behaviors. The achievement test could have assayed such ^>:eading and 
language skills as reading words in isolati Qn»_3pel 1 1 ng, word defini- 
tions.^^ Meanwhi le, the important reading^rements , ^as far the child's 
teacher and her favorite read i ng program were concerned, were reading 
orally, in context and answering comprehension questions. 
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Following are the proce^dures used to place a child in a reader using 
direct and daily measurement* In this example, the decision was made 
to focus instruction initially on oral readir.g. Later, when the pupi' 
could orally read ajt a competent rate in an appropriate level (e«g., 
100 correct wpm in a 3~1 reader), instruction would concentrate more 
on silent reading and comprehension. 

Since oral rea^ding was measured, the behavior of concern, the assess- 
ment was direct. For several days the lad's teacher requires* him to 
read from a number of' books from three reading series — Bank Street^ 
Lippincott and Gi nn. Thus, his performance was measured daily. 

Figure 1 presents the* correct and error rate ranges throughout the 
Assessment period for each book. The hatch mark through each range 
points out his median performance. The asterisk indicates which grade 
leyel from each reading series was selected for the child's reading 
program. * 

When direct and daily 
measurement procedures 
are used to place chil- 
dren for instructional 
purposes in particular 
reading programs, the 
probabi ti ty is great 
^that--a_congenial merger 
between pupil and^proT 
gram will be realized. 
Off^ reason for^this con- 
fidence is that when sev- 
era'J assessirents of per- 
formance are obtained 
before a placement deci- 
sion is made, unusual 
ratings will be tempered 
by more normal scores. 
A second reason to sup- 
port such a presumption 
is that when the behav- 
ior ^of concern is measured di rectly , When the dijgnosed_behay4or be- 
comes the fnstrgcted behavior, a mismatch between pupil and program^ 
-is impossibj^, 

Cormmnication . - = , * - 

Achievement test scbres'^are often used -to report a child's progress , to 
his parents and his teacher. for the coming year* Because of the criti 
cisms ment ioned'^previous ly regarding achievement tests, such a method 
for reporting can be quite misleading. A measure that is takan only 
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once or twice a year that doesn't necessarily measure what the child is. 
being taught, offers a flimsy basis for communication* 

Following the administration of an achievemert test at the close of a 
school year, a pupil's scores in the reading- language arts subtests 
might indicate that his word recognition score was 2,6, his spelling 
score 2,8, and his word meaning score 2.4. JWhereupon these statistics 
could be passed on to the pupil's parents and his teacher for the com- 
ing year. Such- Information, furnished only at the end of the year, 
would notj-eveal to the parents how much progress their child had made 
throughout Athe year. Neither would the parents have information about 
several ot^er skills that were being. taught their child, but were not , 
evaluated^by^fKe test. Next year's teacher, if she consul ted such a 
dossier,' would be equally baffled. She would not know exactly which 
skills the pupil had been working on, which ones he had inastered, or 
"which instructional techniques were effective. ' 

To a. great extent., this communication bewilderment can'be overcome if 
pupil performance is measured directly and daily. Again, in the area 
of reading. If the pupiHs reading program comprised oral reading, an- 
swering comprehension questions and writing resumes about f^e stories, 
measures on those behaviors would be sent ;to^he parents and receiving 
teacher. Furthermore,^ such communj^catjorrwou Id" describe the pupil's at- 
tainments in these skills over an^extended period of time.. Parents re- 
ceiving such information would be enl ightened. as to 'leir child's ac* 
compl ishments. The receiving teacher, so noti f ied-j-v/oul d know exactly 
which skills were being attended to,|which materials and procedures were 
being used, and, perhaps, which i ns-tjructienal techniques had been effect- 
ive. ' _ _ 

Direct and daily measurement facilitates teacher-pupij communication. 
If the child is invoived in looking at or charting his own performance 
scores each day, be becomes aware of his progress; often being able to 
see what is "going on"yis motivating ton a chil'd. This alone can inspire 
children to improve their performance . \ OtKer children, if they "see" 
their achievement worsening from day to day,, request the teacher to help 
them. 



Evaluation ' ' - 

Achievement test scores are also used for purposes of evaluation. These 
scores are used to compare .various methods, such a/ the phonics or the 
sight word method; 'materials , such as- the Bonk Street or Ginn readers; 
tactics, such as flash card drill or tachistoscopic pr-jctice. 

The same criticisms of achievement tests (indirect and infrequent), when 
used for placement and communication, are true when such tests are used 
for evaluative purposes. For^ insta7TCe7 if a teacher uses the achieve- 
ment test meChodology to compare the effects of GInn and Llpplncott 
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readers, *she could first establish two groups^of JcHi Idren, a Ginn and 
a Lipptncott group. Then she could pretest the groups with an achieve- 
ment test, then the treatment periods could be scheduled, followed by 
a posttest on the same or an equivalent achievement test. She might 
then determine the mean and standard deviant ion scores 'of the groups, 
run a t-test and announce the winner. 

In such a scheme, if one reading series seemed to produce better re- 
sults than the other, it could be due more to the fact that the behav- 
iors ta^ht by that method were hiore congruent with the items sampled 
'by- the achievement test than was the case with the other method, than 
due to the excellence of that parUcular, system. Also, the fact that 
the achievement test was given only twice — at the beginning and end of 
the treatment — can provide misleading information. 44-*could be that 
the Vesults at the end indicated that gains occurred for both groups. 
For one group, however, this gain may have been gradual^ throughout 
'the treatment; for the other,, it could have happened .during' the first 
days of the treatment. 

When" direct and daily measures of .performance are used to make similar 
compari^onsT^he results are more valid and certainly more fndividually 
relevant. If the -teacher desired to compare^ral reading rates, for 
example, from^the Ginn and Lippincott re^aders, she could simply have 
the pupil read from both texts for several' days and chart correct and 
"ernor rates for each session. -Throughout this period of assessment she 
could, by observing the data, determine which reader was most suitable 
for the child. She could make, daily, weekly, or monthly across-reader 
comparisons as to correct and error rates. Such an evaluative scheme 
is assuredly preferred to the achievement test strategy since „the data 
pertain to individuals not groups; are obtajined' dai ly , 'not before and 
after treatment; and bear a direct not ^nl4-'ndi+ect correspondence to 
the program being used. . ^^^.^^^ " '° 



ACHm/EMENT TEST AND _DI RECT-DAI LY MEASUREMENT; A COMPARISON 

The data which follow are ach ievement— test scores for. two boys and their 
direct and daily measurement throughout the school year, 1970-1971. 
Paul L. and John were referred to the Curriculum Research Class of the 
Experlmerttal Education Uni^t because of reading problems... Ihey were in a 
class with four other pupils. In September of 1370, all the student^'in 
the class were given^ the WIDE RANGE ACHI EVEMENT TEST (WHAT) (Jdstak, 
Bijou and Jastak, 1965) and the METROPOLITAN ACHIEVEMENT TEST (MAT) 
(1959, 1961, 1965). Both tests were given again in the spring of 1971- 

Table 1 shcftifi the spring and fall scores for the tlass in the two 
achievemenr *test$. Also indicated in the table is the^form of the 
achievement test that wab given, the"^names of the books the pupils were 
placed in, and the grade levels of these books in the fall and spring. 



TABLE I • 

Heading —.grade level scores 



. 1970-1971 



1 9HJL * 




1 FALL 


•MIM 


1 " 


FAU. 




^AUL L. 


1.0 




2.7 . 


2.5 


1 Ll^lNCOTT 
1 fALO ALTO 

1 BANK mm 


aboK 5 

ftlNlft 


2-2 ^- 
2-2' 


^AUL 


2.6 




2.S- 


2^5 


1 BAMCtTKET 

1 SCOTT ftumm 


- * 2-i 


1-1 
«-l^ 




1.1 ^ t 






•.; 


LtmNCOTT 
FALO ALTD 


fW-FtlNta 


2-1 
iookU 




1.$ 






l.f ' 


WiWIU 
BAMK STtttT 




2-2 


MX 






i 




MCMILLAN 




BOON 5 
BOON 5 


MIL 




.1.7 ' 


MS 


^1,1 


XIF^tNCOTT 
•ANK tTRICT 


Fftt-FtlNIJI 


h - 



= INDICATES WHICH BATTEKV WAS GIVEN 
P" = PRIMARY BATTERY 
P^ = PRIMARY^ BATTERY _ - 
E « ELEMFNT/'-^Y BATTERY 
I INT ^TE BATTERY 
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Throughout the year direct and daily data were kept on PauTs and 
John^s progress in oral reading* These data, when compared with the 
achievement 'test scores, often suggest contrary interpretations of ac- 
complishment. The bases for some of these conflicting not ions-wi H"be 
discussed later. 

AH the data^for the direct and daily measurement were taken in a small 
room off the main classroom. In the room were a table, two chairs, a 
tape recorder and some books. Only the teacher and the cHild-^were pre- 
sent during the reading sessions^. Each child read for five minutes 
from two readers -each day. The tea1:her counted correct and error words 
orally read and the reading was timed^ith a stopwatch. Errctrs consist 
ed of substitutions, additions, and omissions. All errors were correct 
ed by the teacher after a Srsecond pause to al.ow fcr self-correction. 
If the child corrected hi msel f .before the teacher supplied the words 
it was not counted as an error. ' " ' . 



Paul - . / 

Paul L. was an eleven-year-old boy. When he was given the HAT (Pri- 
mary 2 Battery) and the WRAT in Septen^er, his reading scores were 1.0 
and 2.7 (see Table 1). In Septembjer when the teacher used-direct and 
daily measurement, for diagnosis, he was placed I n_the Palo Al to Book 3 
(first grade level) and the Bank Street primen — Trtus, the HAT score 
was more commensurate.^wi th his actual placement than the WRAT. In 
September, PauPs median correct rate was 29.6 words per minute (wpm) 
in the Bank Street primer with a median error rate of 2.0 wpm (see Fig- 
ure 2) . . ^ . , 




--Ft^.-*2. Direct and daily 
measurement of words read 
orally i-'n the acBUemic year 
1970-1971 for Paul L- Any 
breaks in the data indicate 
absences, weekends or vaca- 
tions. The vertical lines 
ImJ^cate when different in- 
structjonaJ^gi^Qcedures were 
p u f Tn^e f ^ 3c t . ^he^ c i re I ed 
numerals above the correct 
rate plots indicate median 
correct rates for each phase 

and the numerals within the triangles indicate median error rates. 
Two medians were figured for' condi t ions which were- separated by vaca- 
tion periods. The arrow and date at the top of the chart indicate « 
the days data were first taken during eacfijuarter. 



tUCCfttlVi DAYS 



*ptki% 1971 



In May, when the achievement tests \/ere given again, Paul scored 2.7 
on the MAT reading subtest and 2.5 on the WRAT. From fall to sprin*:. 
his MAT score rose K7 of a grade level and his WRAT score fell .2 o: 
a grade level. In May, Paul read In the 2-2 reader of the Bank Street 
and Lipplncott series. At that poh t, both achievement test scores 
agreed rather closely with the direct and daily measurement. Neither 
achievement test scorje, however, revealed, as did the direct and daily 
measurement, that Paul's correct rate in May had risen to a median .of 
65.8 wpm and his error rate had dropped to 1,0 wpm. Thus, throughout 
the year, Paul made progress not only through the matecials — from 
primer to 2-2 in Bank Street — but also showed a definite improvement 
in correct and error rate. From September to May' he was reading more 
difficult material faster and more accurately. 

Paul's direct and daily measurement alsoj clearly show how this method 
of assessment enabled his teacher to evaluate various instructional 
techniques. As indicated in Figure 2, Paul's Improvement was not steady 
throughout the yea^i^At a number of times between September and May, 
Paul's performance bd|an to deteriorate; his correct rate fell and his 
error rate rose. Because the teacher was obtaining direct and daily 
measurement, she saw these patterns as they developed and was able to 
make instructional or contingency alterations immediately. She did not 
have to wait until May to discover that the pupil was not progressing 
satisfactorily. 

In the winter quarter, such a performance decline was noted. The verT_ 
tical line in the figure from winter, 1971 > indicates where a decision 
to change procedures was made. At this point a 30:1 point contingency 
was instituted. For every thirty correctly read words, Paul received 
one point, redeemable for one minute of free time. Following this pro- 
cedural change, Paul's performance improved; his correct rate rose 
while his error rate declined. 

Because the teacher was taking direct and daily measurement on oral 
reading, she was certain that^'those data meant progress in that ski 1 1 > 
The data did not reveal, necessarily, any Information about his ability 
to perform on an achievement test. This point is especially relevant 
when considering the scores from the WRAT. Paul's reading scores from 
September to May in the WRAT showed a drop of .2 of a grade level, yet 
his dally data showed that he made considerable gains. 

The reading subtest in the WRAT requires the child to read a list of 
words. The direct and daily measurement pertained to Paul's reading 
words in context. Reading word lists Is certainly a different task 
than reading a story, so a score based on reading word lists might 
have little relationship to a score on reading a text. 
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John 

John was a nine-year-old boy. In SepterAer, when' the achievement tests 
were first given, his score was U on the MAT (Primary Battery) and at 
the seventh month of kindergarten on the WRAT (see Table 1). At that 
time John was placed in a Lippincott pre-primer on the basis of direct 
and daily measurement taken in a number of readers. 

Figure 3 shows John^s direct and daily data from fall and spring quar- 
ters. During tlie first three weeks of school John's median correcf^^ 

rate in the Lippincott book was k5 wpm with an error rate of 1.8 wpm. 
His reading fluctuated widely from day to day; correct rate scores 
ranged from 21 to 100 wpm and error rate scores from .3' to 9.0 wpm. 
In Hay, John waw^ding in the 2-1 Lippincott reader; his median cor- 
rect rate Wis' 7?" wpm and his median error .rate was 2.2 wpm. As the 
chart shows, his performance, insofar as correct and error rate was 
concerned, was much more stable in the spring than in the fall. ^ 

John's data show even more 
clearly than Paul's how dis- 
crepant a child's achievement 
test scores can be from his 
direct and dai^ly measurement. 
John's progress, as indicated 
in Figure 3, was impressive. 
From September to May he was 
reading more advanced material, 
his correct rates were more 
stable, his correct rates high- 
er, and error rates lower. In 
spite of thij^ improvement, how- 
ever, he did not progress eight 
years in reading ability^ one 
year's time as the WRAT scores 
would suggest (see Table 1). 
As previously mentioned, the 
reading test on the WRAT asses- 
ses the skill of reading iso- 
lated words, .while the direct 
and daily measurement pertained 
to reading words in .context. 
If John's teacher for the fol- 
lowing year were .to place him 
on the basis of his WRAT score, 
she might be tempted to begin 
him in a junior high reader, 
when he, in fact, should read 
from a second grade text. 
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Fig. 3. Direct and dalLy meas- 
urement of words read orally in 
the fall and spring quarters 
(1970-1971) for John. The ver- 
tical line in the spring quarter 
indicates that a procedural change 
was made* 



DISCUSSION , 



Direct and daily measurement not only provides placement, communica- 
tion and evaluative information, but also furnishes some valuable 
clues for remediation. When the direct"^nd daily measurement method 
is used for initial placement purposes, the teacher may be supplied 
clues regarding which tactic to use in order to assist his pupil's 
reading. Using the direct and daily method, a teacher can easily ob- 
serve which types of - reed ing errors are being made. It may be re- 
vealed that the child reads in a Jerky manner, that he can't decode 
words that begin with £l or br, that he substitutes one noun for an- 
other, or that he confuses pronouns. When specific remediation pin- 
points can be identified early, remediation and subsequent improve- 
ment can be quickly realized. 

_ «■ - « 
By contrast, achievement test scores provide little if any assistance 

to the teacher when it comes to selecting remediation strategies. 

The same criticisms expressed earlier of achievement tests, that they 

provide indirect information and that, only infrequently, preclude 

their being used for diagnostic purposes. 

In reading, when an achievement test is used to indicate progress 
from one period of time to another, only a grade level change is pro- 
vided (e.g., from 2.6 to 4.0). As— discussed, this grade level ad- 
vancement may not correspond to. the. reading behaviors that were being 
taught. When direct and daily measurement is used to evaluate progress 
grade level changes pertain to the program which the child is using. 
In addition to providing grade level information, direct and daily 
measurement shows a pupil 's correct and error rate scores over a per- 
iod of time. The ratio between these two rates at any given time is 
an indicator of the quality of his performance. Thus, speed of read- 
ing correctly and incorrectly as well as accuracy are shown. 
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Acquisition OF 

PHONETIC SOUNDS BY PRESCHOOL CHILDREN 

L EFFECTS OF RESPONSE 
AND REINFORCEMENT FREOUENCY 

H. EFFECTS OF TACTILE . ^ 

DIFFERENCES IN DISCRINUNATIVE STIMULI ^ 

Virginia L massad 
barbara c. etzel 



The initial .study Experiment I compared pre- 
school children's acquisition of pointing to a 
letter in response to its phonetic sound during 
^conditions of a high ratio of required responses 
and delivered reinforcers to instructions or 
cues (frequent condition) with a low ratio of 
the same (infrequent condition). The first con- 
trol study compared the effects of a high ratio 
of delivered rei nforcers to instructions with a . 
low ratio of the same while required responses/ 
as well as number of instruciions were held con- 
stant. The second compared the effects of a 
high ratio of required responses to instruction 
with a low ratio of the same while delivered re- 
inforcers were held' constant". ¥• 

In the three studies, each subject served as his 
own control (i*e., a discrimination between two 
letters was acquired during conditions of high 
ratios and another discrimination was acquired 
between two different letters during conditions 
of low ratios. Acquisition with these procedures 
was replicated for each subject with a second set 
of letter pairs. The conditions during which the 
pairs of letters were trained and the sequence of 
training either the hfgh or low ratio discrimina- 
tion first during a session was controlled between 
subjects. 
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The results of Experiment I showed that acquisi- 
tion occurred more rapidly and with fewer e»"rors 
under the ^requent condition than the infrequent 
condition. The results of both control studies 
supported the conclusion that the high ratio of 
responding was a more important variable in Ex- 
periment I than the high ratio of reinforcemeot 
as used in thisrs4;udy. 

Experiment II compared the acquisition of two let» 
ter-sounds under conditions of a tactile response 
to a sandpaper letter and a tacti le response to a 
painted letter. Both conditions incorporated a 
high ratio wf required responses and reinforcers 
to instructrons. Each subject was his own control 
(i.e., acquisition of one letter-sound was with 
the condition of a sandpaper stimulus and the oth- 
er with 3 painted stimulus). These acquisitions 
were replicated with each subject with two addi- 
tional letters. The conditions during which the 
letters were taught and the sequence of teaching 
either sandpaper or paint first during a session 
was controlled between subjects. The results 
"showed that acquisition was more rapid, with fewer 
errors with tactile responses to sandpaper than to 
pai nt letters . * 

4 

Educationa! and psychological 1 t terature has not yielded a large number 
of studies to guide teachers In their choice of procedures or materials 
when teaching conceptual skills. Intuition rather than data generally 
guides educators In selecting a particular procedure or a piece of equip 
ment. Those few studies that do-have a more direct application to the 
methods area are those that have shown the effects of a mediating verbal 
response on measures of: rate of learning (Welr and Stevenson, 1959); 
memory {Hagan and Kings ley, 1968); and accuracy of responding (Lovitt 
and Curtlss, 1968). Two studies, also concerned with procedures and 
materials compared active participation to passive listening of kinder- 
garten children (Blank and Frank, 1971); and rough with smooth stimuli 
(GUner, 196?)* 

Many preschools, kindergartens and special education classes have used 
Montessori materials for years, but comparisons that have been made on 
the construction of the materials and "he method of using them are so 
gross that statements cannot be made concerning what piece of equipment, 
used in what way, will or will not result in a child's acquisition of an 
academic skill. It still remains necessary for learning specialists to 
specify those variables. 

The present research was carried out to serve as one type of model for 
studying specific variables in methods and materials research and as an 



example of a design that can more efficiently handle individual differ-- 
ences among subjects* learning rates. It involved preschool children's 
acquisition of pointing to letters in response to thei r phonetic sound 
production by the experimenter. This acquisition was compared during 
different teaching procedures and with different teaching materials. 

Experiment I compared the frequency (frequent versus infrequent) of a 
child responding (and reinforcement) while the amount of information 
given under both conditions was held constant.- Two coni.'ol- studies 
were then carried out. In the first control study the number of rein- 
forcers given to the child were varied (frequent versus infrequent rein- 
forcers), but information, cuing- the responses and number of responses 
were all held constant* The second control study varied the number of 
teacher cues and subsequent child responses (frequent cue- responses versus 
infrequent cue-responses) ' whi le holding information and reinforcement con- 
stant. 

Experiment II compared the acquisition of. pointing to letters in response 
to their phonetic sounds using tactile responses to sandpaper with acqui- 
sition using tactile responses to painted letters. 

Table 1 summarizes the variables .studied across the two experiments and 
the two control studies. The upper box separates the two main variables 
studied in Experiment I (experimenter*cue and subsequent subject- response, 
and reinforcement.) into frequent and infrequent conditions for each var- 
iable. As indicated, Control Study A was designed to investigate fre- 
quency of reinforcement and Control Study B to investigate frequency of 
experimenter-cue and subsequent subject-response. 

The lower table summarizes the four studies by the type of variable being 
investigated and the number of times it was presented. Brief examples 
of each of the variables manipulated in the training sessions are noted 
under examples and conditions. In all four studies, each subject received 
both independent variables. 



METHOD 

Subjects and Setting 

A total of 25 children from the Edna A. Hill Child Development Preschool 
Laboratories at the University of Kansas and the Lawrence Presbyterian 
Church Preschool participated in these studies. 2 They ranged in age from 
three years, one month to four years, eight months. All children had inr 



The authors wish to thank \Ars. Josephine Anderson for her kind as- 
sistance in carrying out this project with their children, at their 
school . 
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TABLE 1 

DESIGN OF EXPERIMENT I AND CONTROLS A AND 



EXPERIMENTER-CUE AND SUBJECT-RESPONSE 



2: 

bJ 

LU 

o 





Frequent 


Infrequent 


c 


Experiment I 




cr 

0) 


Control A 


Control B 


u 
U. 


Control B 


N = 2 


cr 






0) 

1. 


Control A 


Experiment I 


C 


N = 4 


N = 11 



^lach 6tudy {example: CONTROL A) contains tha -6ame ^ubjacjU In both 

CQJUU. 



FREQUENCY OF EXPERIMENTER'S PROCEDURES & SUBJECT'S RESPONSES 
PER TRAINING SESSION ACROSS' GROUPS & STUDIES 



Frequency of 
Experimenter's 
Informative State- 
Independent ment Per Letter 
Study Variables^ Per Session** 



Number of Paired 
Expe r i me n te r - C ues 
£ Subject-Responses 
Per Session*** 



Frequency of 
Rei nforcers 
Per Session 
**** 



Exp. j Fr-Resp. 
1 1 In-Resp. 


5 

5 


1 ' 

2 1 2 


Con- 1 Fr-Reinf. 
trolAl In-Reinf. 




5 1 5 
5 1 2 


Con- Fr-Resp. 
trolB In-Resp. 




5 i 5 
2 5 


Exp. 1 Sandpaper 
1 1 I Paint 


5 
5 


5 1.5 
5 5 



^^Van^able^ t Fr-Resp. = Frequent Response 

Fr-Reinf* = Frequent Reinforcement 
In-Reinf. = I nf requent Rei nforcement 
In-Resp. = Infrequent Response 

Bxamplu 0({ Condition : 
** I nformati ve Statement: Experimenter, "The sound of this letter is 

"bu." (bu as in book) 
¥'¥*Cue: Experimenter, "Point to bu and say bO." 
Response: Subject points and says, "bO," 

**** Experimenter gives praise and token. 



dividual training sessions and test probes each day they attended school. 
These were held in experimental rooms in close proximity to the preschool 
classes . 



Materials 



The materials used were the Montessori lower case letters made of sand- 
paper (and paint for Experiment II). These letters were mounted on 
V' x,6*' red fiberboard. The. pairs of letters trained were m-a^ b-^'n^ 
a-Sy t-r and h^-a (the latter being a substitute pair). The individual 
letters were selected on the basis of the frequency of their occurrence 
in early reading words and the pairings were made on the basis of dif- 
ferences (subjective) on a visual and auditory basis. 

Pretest and Posttest 

A pretest was administered to screen for prior knowledge of each pair 
of letter-sounds to be trained. The response requited was one of point- 
ing to the letters in response to their phonetic sclnd production by the 
experimenter. Each letter-sound was tested three times and any child 
who scored over -33^ correct on any pair of letter-sounds was not included 
in the study. Each response on the pre- and posttests that the child 
made (regardless of whether it was correct or incorrect) was followed by 
a comment such -as, ''Good try," or "That's fine.'* 

After acquisition of the letter-sounds, subjects were posttested with the 
same procedures and stimuli as those used in the pretest. The criterion 
.for moving from the training sessions to the posttest was 100^ correct 
responding for two successive days on the test probes given during the 
training sessions. 

Reinforcement Procedures and Test^Prohes 

During acquisition training of the letter-sounds all the subjects' cor- 
rect responses were reinforced with a token (with backup toy available) 
plus a remark of praise or approval from the experimenter. Correct re-* 
sponses emitted during the daily test probes which immediately followed 
the daily training sessions were reinforced in like manner. The exper- 
imenter made no response to incorrect choices during the test probes, 
but simply went on to the next trial. 

Reliability 

Reliability checks were taken intermittently during the four studies by 
having an observer independently record the experimenter's training pro- 
cedures and the subjects* responses during training, test probes and 
posttests. The average agreement was S3%* 
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Oexperimewt ? 

Training Sessions and Test Probes 

After the pretest, eleven children were taught two pairs of letteT^ 
sounds, one pair under frequent conditions, the other pair under Infre- 
quent conditions. As Table 1 shows, both letters of the pair assigned 
to the frequent condition of training were presented Individually with 
five experimenter-cues for responses to point (to the letter) and say 
(the sound of the letter) fjve subject-responses and five reinforce- 
ments. Each letter of the pair assigned tc .ite Infrequent condition 
was presented with two each of- the same procedures. All other teaching 
I nformat Ion *.glveft to the subjects was the s^ame'under both frequent and 
infrequent conditions. The first experimental condition presented oo^ 
any one day alternated between the frequent and infrequent condition's.^ 

During the same session, and immediately following the training of each 
pair of letter-sounds, the child was given a six-item test probe on the 
two letters. Each test probe contained six trials (three presented in 
a random order for- each letter-sound). Each test probe trial always 
involved the two letters that were being taught and an additional dls- 
tractor (the letter x or z) . These test probes had two forms (alter- 
nated between sessions) and differed -in arrangement of the three stimu- 
lus choices. 

Although the ratio of responses and reinforcement was five for each let- 
ter during frequent to two during infrequent condi tions , the amount of 
experimenter information provided for the child was the same. There 
were ten identical informative statements during both conditions. The 
only difference between the two conjdi tions was the number of experimenter 
requests for a subject to respond, the number of responses and the number 
of reinforcers. 

All subjects continued this training until they met ^ criterion of two 
consecutive days of 100^ correct responding on the iaily test probes 
under both conditions, in addition to 100% on the posttest. 

Design 

In Experiment I an individual analysis with group controls was Incorpor- 
ated. The, design Is presented in Table II where the conditions are noted 
for each subject who served ae-his own control for the main independent 
variable under study (frequi^t'versus infrequent). In the same session 
each child was taught twoyHetter-sounds with frequent responses and rein- 
forcement and two letter^^ounds v/ith infrequent responses and reinforce- 
ment. Therefore, this viks an Individual analysis design, in that each 
child experienced both rrequent and infrequent conditions, with a repli- 
cation (noted as Problem 2 in Table II) of these conditions with four 
additional letter-sounds. The subjects were grouped and the groups 
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counterbalanced to control for such variables as: the sequence of con- 
ditions during which the letter-sounds were learned; which letter of a 
pair was presented first In any session; or In the first or second prob- 
lem; and the assignment of letters to either of the two conditions. 



Results ' . . ' 

The data were analyzed and graphed on the basis of the dally test-probes 
that followed the training sessions for each pair of letters. In this 
experiment there were six trials for each pair of letters (under each 
condition), three for each of the letter-sounds trained. The percent 
correct under each condition was based on the number of correct re- 
sponses out of the total of six possible for each pair. 

The mean percent correct responses for all subjects to the pretests, 
daily test probes and posttests are presented in Figure 1. The last 
two days of the traini ng sessions when each subject met the 100? cor- 
rect responding on" the test* probes are not Included In the data. 
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Fig. I. Group data of mean percent correct responses on daily 
test probes for each session of Experiment I under both condi- 
tions for Problems I and 2, ^ 
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The data from the pretests indicate a correct responding level of about 
20^ for the letter-soiinds assigned to both the frequent and the infre- 
quent conditions. As training progressed, the frequent condition (solid 
curve) produced a greater percent. correct responding than the infrequent* 
The only exception is Session 8 of Problem 1. The same trend also occur- 
red in the replication (Problem 2), even though fewer sessions were nec- 
essary for the children to reach criterion for all letter-sounds. 

The top graph of Figure 2 shows the mean number of sessions to criter- 
ion performance for the frequent and infrequent conditions for the group. 



Sessions to Criterion 
Performance 




Problem 1 Problem 2 




Problem 1 Problem 2 



Fig. 2. Group mean number of sessions to criterion perform- 
ance under both conditions of Experiment I for Problems I 
and 2. Group mean number of errors to criterion performance 
under both conditions of Experiment I for Problems I and 2. 
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The frequent condition (striped bar) had a mean of k.k sessions to cri- 
terion performance as compared with 6.3 in the infrequent condition 
(spotted bar). The same trend occurred in the replication (Problem 2). 

The bottom graph of Figure 2 shows that 7.0 mean errors to criterion oc-. 
curred during the frequent condition as compared with 12.4 during the 
infrequent condition. Again^this trend occurred in replication. 

Examination of the individual data showed that all subjects tended to 
have similar individual graphs to the group graph. These results indi- 
cate that even though the amount of instructional information was held 
constant, letter-sound acquisition occurred niore rapidly; that Is, in 
fewer sessions and with fewer errors during frequent response and rein- 
forcement than during infrequent response, and reinforcement conditions. 
However, it is not clear from tl.ese data whether the more frequent sub- 
ject-responses or the more frequent reinforcement was the major variable 
contributing to the effect.^ Therefore, two control studies were run 
using a simi lar individual analysi,s comparison with group controls*, as 
described in Exi5eriment I. , 



CONTROL STUDY A 

In this study, four preschool children served as the subjects. The 
number of reinforcers given to each subject varied, but all other 
training procedures remained constant. This meant that the information 
given to the child, the experimenter cues (instructions) and the number 
of responses were the same. This study was carried out as the first 
control procedure where the effects of frequent and infrequent reinforce- 
ment were studied under the frequent procedures used in Experiment 1. 

Training Sessions 

Each child was trained on two pairs of letter-sounds for each problem. 
One pair of letter-sounds was taught with ten reinforcers per session 
and the other with four. In this study there were always ten subject 
responses under both conditions. The training and test probe procedures 
were the same as in Experiment I, except that some subject responses 
were not followed by a token or social reinforcement due to the infre- 
quent reinforcement condition. 



Design 

Each subject was his own control for the main independent variable in 
that each child learned two pairs of letter-sounds during the same ses- 
sions, but one pair was acquired under a condition of frequent reinforce- 
ment, the other under a condition of infrequent reinforcement. 6roup 
controls were incorporated as described in Experiment I. 
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EesultQ 

The' results of this first Control Study are shown in Figure 3. The 
mean percent correct for. all four chi Idren-duri ng frequent reinforce- 
ment (solid line) was not appreciably different from that during the 
infrequent reinforcement training (dotted line) in that both curves 
overlap across sessions. This same observation of no differences for 
frequent or infrequent reinforcemefit also held during the replication. 
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Fig. 3. Group data of mean perc:ent correct responses on 
daily test probes for each session of Control Study A 
under both conditions for Problems I and 2. 



Figure 4 shows the group mean number of sessions to criterion (top 
graph) and errors to criterion (bottom graph). These data were also 
similar during frequent and infrequent reinforcement, 7.8 and 7.0 ses- 
sions to criterion (respectively), and 16.5 and 15.5 errors to criter- 
ion. Replication (Problem 2) resulted Inan.equal number/'oPsessions 
(1.5) and errors (2.0) to criterion during both frequent and Infrequent 
reinforcement conditions. 
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ditions of- Control Study A 
for Problems I and 2. 
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of Control Study A for 
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Examination of the individual data showed that the four subjects tended 
to have similar individual graphs to the group graph. None tended to 
show any individual bias toward one method* 



CONTROL STUDY B 

l*n this study, with two preschool children as subjects, the number of 
experimenter cues and subject-responses were varied but the other train- 
ing procedures remained constant. This meant that the information given 
to the child and the number of reinforcements were the same. This study 
was carried out as a second control procedure where the effects of fre- 
quent and infrequent experimenter-cues and subject-responses under the 
same training procedures of Experiment I were studied.- 
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Training Sessions ^ - • , 

Each chUd was trained on two pairs of letter-sounds in each session, 
one pair with ten responses, the other pair with four. There were al- 
ways ten reinforcers delivered during the training of both pairs of 
letter-sounds even though the child responded only four times during 
the infrequent response training condition. This was done by giving a 
token and social praise for attending to the stimulus letters at the 
time when the child would have responded if he were in the frequent re- 
sponse condi t ions. In all other respects thd training procedures were 
the same as described in Experiment I. 

Design 

Each subject was his own control for the main independent variable in 
that each child learned tv/o pairs of letter-sounds during the same ses- 
sion but one pair was acquired under a condition of fri^quent responding, 
the other under infrequent responding. 

Results 

The mean percent of correct responses on the daily test probes for 
both subjects is shown in Figure 5- Higher percent correct test probes 
resulted during t!he frequent response condition (solid line) than dur- 
ing the infrequent response condition (dotted line) except for Sessions 8. 
10 and' 11. This was also true during the replication. 

The group mean number^of sessions and of errors to criterion are shown in 
Figure 6 and indicates faster acquisition of letter-sounds trained during 
the frequent response condition (7-5 sessions) than during the infrequent 
response condition (8.5 sessions). The different in acquisition was 
even more evident in mean number of errors (bottom graph). The frequent 
response condition had an average of 17 errors as compared to 26 errors - 
during infrequent training. The same trend occurred during the replica- 
tion, 

A summary of the results of Experiment I and the two Control Studies 
demonstrated that children learn more rapidly in that they take fewer 
sessions and make fewer errors during conditions of a high ratio of re- 
quired responses than during a low ratio of the same. In addition, !t 
appeared that frequent responding was a more critical variable than fre- 
quent reinforcement for faster acquisition. 
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Fig. 5. Group data of mean percent correct resDonses 
.on daily test probes under both- conditions of Controi 
Study B for Problems I and 2. 
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Fig. 6. Group mean number of sessions to criterion performance 
under both conditions of Control Study B for Problems I and 2. 
Group mean number of errors to criterion performance under both 
, conditions of Controj Study B for Problems I and 2. 



OeXPERIMEWT II 

Following the development of a teaching procedure and the Investigation 
of some of the variables contributing to letter-sound acquisition by 
that procedure, the" effects of a teaching material were then studied on 
letter-sound acquisition. In this experiment the subject used a tactile 
response of moving the finger over sandpaper and painted letters during 
training on letter-sounds. This study. In which eight preschoolers par- 
ticipated, was undertaken to demorvstrate the type of '^materials research^^ 
that should be carried out and a design to use to help minimize individ- 
ual differences. 



METHOD 



Materials 

The materials 'used during the training sessions and tesv: prtjbes were 
the Montessori sandpaper letters. The pairs of letter* trained were 
m-c^ r-h and Z?-/. The latter set of letters was a substitute pair. 
Duplicate letters were painted to match the color of the sandpaper 
letters. The other distractors, x and used only during the test 
probe, were cut from cardboard to match the color of the sandpaper and 
paint* 

Pretest and Posttest 

*The children were given pre- and post tests of pointing to the sandpa- 
per letters, following the same procedures and with the same materials 
used: in Experiment I. 



Training Sessions 

On the first session of training the experimenter sat by the side of 
the subject and demonstrated how to follow the outline of the letters 
with the index finger. Then during the res't of the training only the 
subject used a tactile response of moving the finger over the sandpa- 
per and painted letters when instructed to, "Feel- (the letter) and say 
(the sound of the letter).** ' 

Each letter was presented with five informative statements such as, 
"This is the first sound you make when you- say boy^** Each statement 
was then followed by a request for a response to feel and say, such as, 
**Feel bu and say few." The other letter was then taught in the same 
manner. For each subject, one letter was assigned to the sandpaper 
condition and the other letter to the paint condition. The first pre- 
sentation of each session alternated between sandpaper and paint. Fol- 
lowing the training of sandpaper and paint letters, daily test probes 
on those two letters were administered, where the subjects only pointed 
The six-item probes contained three trials for each letter-sound taught 
Each trial involved the two letters, plus one of the cardboard distract 
ors, a? or 2. 

'Training was continued until the children reached a criterion of two 
consecutiye days of 100% correct responding plus 100% on the posttest- 

Design 

Experiment II employed both an individual analysis design and^group con 
trol as u.ed in Experiment I. Each subject was his own control for the 
main independent variable under study. Also, each subject engaged in a 
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subsequent replication of the first condition, but with two new sounds. 



Results 

The pretest, dally test probes and posttest data for sandpape, a^*^ 
paint conditions are presented in Figure 7* Each data point represents 
the mean percent correct for that session for the group and does not In- 
clude the two successive days of 100% correct responding prior to the 
posttest. The data for the pretests (on the lower left corner) indicate 
a similar correct responding level for the letters assigned to both the 
sandpaper (sal id line) and paint conditions (dotted line).. As training 
progressed the sandpaper condition always resulted in higher percent 
correct responses except for Session 11 when they were the same. Simi** 
lar results occurred In the replication. 
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Fig. 7. Group data of mean percent of correct responses on 
daily test probes under both condTtions of Experiment II for 
Problems I and 2. 
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In' the top graph of Figure 8, the mean sessions to criterion for the 
sandpaper -condi tion (hatched bar) was smaller than the mean sessions 
to criterion for the paint condition (white bar), ^.8 and 7,5, re- 
spectively. This was also true in the replication (2-3 and 3:6). 

The mean errors to criterion during the paint condition (11.8) was 
more than twice^the number of errors to criterion during the sandpaper 
condition (5.6). Errors to criterion during the replication were 6.Q 
and 2.8, respectively. 

These results indicate that tactile responding to sandpaper letters re- 
sults in faster acquisition with fewer errors and sessions to criterion 
than tactile responding to painted letters. 

Sessions to Criterion , 
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Fig. 8. Group mean number of sessions to criterion perform- 
ance under both conditions of Experiment II for Problems I and 
2. Group mean number of errors to criterion performance under 
both conditions of Experiment II for Problems I and 2. 
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DISCUSSION 

The results of Experiment I with the Control Studies suggest that 
teachers should be using procedures that incorporate frequent child 
responses. Training in behavior modification techniques most often 
emphasizes the use of reinforcement in teaching. However, these re- 
sults indicate that frequent responding during acquisition should be, 
at least, equally emphasized. Also,' lengthy instructions or short 
''lectures** before asking children to respond are probably not as effi- 
cient as teaching procedures to increase child responding. The tech- 
nique of obtaining frequent responses from chi Idren ei ther in individ- 
ual or group, settings needs to be explored to its limits. 

Many reasons for why a higher ratio of responding resulted in more rap- 
id learning with fewer errors could be given. The most obvious explan- 
ation would be a **phys lological** link. That is, more sensory receptors 
and effectors are involved in frequent responding. The difference be- 
tween responding to letters during frequent and infrequent conditions 
In this study was not simply a ratio of five to two. The children looked 
at the stimuli, heard the sound, verbalized the sound and pointed to the 
letter many more times in the frequent than in the infrequent conditions. 
Thus, a compound effect tnay have occurred*wi th the more frequent sensory 
receptors (hear and see) and effectors (say and point). This could have 
contrifjted to more accurate responding and more rapid acquisition. 

I.t is important to note that the subjects who required the largest 
number of training sessions did not readily respond to instructions. 
Their correct responses during acquisition fluctuated over sessions. 
The behaviors of these subjects Indicate that before acquisition of 
a concept can occur some children may require a shaping procedure to 
first acquire attending behavior. 

In addition to teaching procedures, teaching materials may have differ- 
ential effects on skill acquisition. Experiment II was designed to in- 
corporate a teaching procedure already found to be superior to another 
and then vary a material to see if further differences could be obtained. 
The results suggest that teachers should explore novel or d i f ferent-f rom- 
usual teaching materials. It Is dl^fficult to argue that sandpaper is 
the only material that could produce more rapl^d acquisition. Perhaps 
sandpaper is novel in the chll<* 3 stimulus environment, whereas painted 
stimuli are more common. It could also be argued that anything differ 
ent" (e.g., velvet or fur) would have the same effect. On the other hand, 
it could be an interaction of both stimulus novelty and increased tactile 
stimulation which produced faster learning. 

Using each child as his own control with respect to the main independent 
variable is essential in studies (like those presented here) which seek 
optimal procedures for effecting learning acquisition. Each child's 
replication of his own first study by engaging in a second study (Prob- 
lem 2) increased the reliability and generality of the findings. Although 
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there were always fewer sessions and errors during acquisition of the 
second problem, the differences obtained during any one of the studies 
on the second problem were consistent with those under the first prob- 
lem. Only with this type of an individual analysis design are differ- 
ences in children's acquisition rates controlled. 

For example. Figures 9 arid 10 show the data of -Experiment I if they 
were treated in the manner of the'' tradi t ional group design. Eight of 
the subjects were taught the same pairs of letter-sounds (r and and 
b and n). Since the conditions under which the pairs were taught were 
^~counterba lanced, then one hatf the subjects could comprise a group 
treated with frequent conditions, the other half, a group treated with 
infrequent conditions. If the decislon'df which subjects were to re- 
ceive frequent and infrequent training were decided by a coin flip, the 
research design would become a traditional group design! 

As Figure 9 shows, the group treated with frequent reinforcement and re- 
sponding (solid line) did not acquire the letter-sounds more rapidly 
than the group experiencing infrequent presentation of these variables. 
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Fig* 9. Mean percent of correct responses per session for 
frequent and infrequent groups for Problems I and 2. 



Further, the upper graph of Figure 10 shows that the frequent group 
(striped bar) required a slightly teigher m an number of sessions to 
criterion (6.8) than did the infrequent group (6.0, spotted bar). 
The bottom graph of Figure 10 shows that the subjects acquiring let- 
ter-so:- -Is in the frequent condition also had a higher mean error 
score (16.3, striped bar) than those learning In the Infrequent con- 
dition (15.0, spotted bar). In this design, a statistical analysis 
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Fig. 10. Mean number of sessions to criterion performance 
under both conditions of Experiment I for frequent and in- 
frequent groups for Problems I and 2. 

Mean number of errors to. criterion performance under both 
conditions of Experiment I for frequent and infrequent * 
groups for Problems I and 2. 



would probably result in **no stgntftcant differences^* and educators 
would be caught in the same dilemma that has plagued them for years. 

These latter data did not support the conclusions we derived from the 
individual analysis design. However, the replication results of 
Problem 2 are consistent with our original results. The differences 
resulting from the two analyses of the sake data can ..be attributed to 
individual differences in acquis i ti onr^r^es . Because of these indi- 
vidual differences, utilizing the individual as his own control in 
two different treatment conditions is obviously preferable to compar- 
ing treatments between groups of different children. When individual 
learning rates are controlled by design rather than by statistics, 
the formation of the laws of psychology and education will advance 
more rapidly. 
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Open classrooms: 
supportbrs of applied behavior analysis 



mary mcneil; susan hasazi 
adier mullen martha knight^^ 

During the current school year, the entire teach- 
ing/administrative staff of the Hinesburg Elemen- 
tary School in Hinesburg, Vermont is working with 
consulting teachers to develop and implement in- 
dividualized Instructional programs for chi*ldren 
in regular classrooms with deficit behaviors^ 
The consulting teacher and the staff work togeth- 
er to provide this special education through the 
following steps (McKenzie, 197^1): 

* l^i^The classroom teacher identifies 

the child in need of special edu- 
cation and refers him to the con- 
sulting teacher, 

2^^The classroom teacher and the con- 
sulting teacher define behaviorc^.l 
objectives and devise measurement 
procedures that will reflect achieve- 
ment of the defined objectives. 
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3<^The classroom teacher obtains daily 
reliable pleasures of the child's 
achievement. , 

41i^The consulting teacher determines 
that the child Is eligible for spec- 
ial education If the dally measures 
reflect achievement below the de- 
fined behavioral objecilves. 

5^^The classroom teacher;jod the con- 
sulting teacher inform the parents 
that their child Is eligible for 
special education and obtain paren- 
tal permission to provide special 
education. 

6^^The consulting teacher develops an 
Individualized learning program for 
the chi I d. 

7^^The classroom teacher implements 
the individualized learning program 
and obtains dally reliable measures 
of achievement. 

8^^The classroom teacher and the con- 
sulting teacher continue to work 
with the child until he has achieved 
the defined behavioral objectives 
and Is therefore no longer eligible 
for special education. 

The HInesburg School presented a unique chc^llenge to the 
consulting teacher because it represented a philosophy 
of education traditionally considered antagonistic to a ' 
behavioral approach such as that used by the consulting 
teacher^ This philosophy Is based on the open classroom 
model exemplified In the British Primary Schools. In the 
open classroom model, large groups of children are pro- 
vided with a variety of activity centers through which 
they may move freely and converse as they work (Stroud, 
1970) ♦ Typically, work projects are Initiated and car- 
ried out by Individuals or small groups* This flexible 
arrangement affords maximum Interaction between children 
hot possible In the traditional self-contained classroom* 

The open classroom approach was new to the HInesburg 
School. During the summer months both the principal and 
teachers had agreed to remove partitions between the pre- 
viously Self-contained classrooms In order to provide 
large open spaced areas for each group. Two and three mem- 
ber teaching teams were assigned frot.i 48 to 72 children 
homogeneously grouped according to age. 



CLASSROOM MANAGEMENT 



Referral 



The first referral for special education In the open classroom did- 
not involve the typical one chll.d and one teacher, but children 
and three teachers. The teachers reported that until organization 
and management problems were remediated Individual behavioral defi- 
cits could not be Identified accurately. 

The teachers stated their major problems as being related to time 
spent In moving from one activity to another, Individualizing In- 
struction, pupi 1 motivation, and working effectively using a team 
teaching approach. 



The dependent variable measured was minutes when the entire group 
was Involved In the following non-academic tasks: 



Procedure 

The class was divided Into thirds and each group was Instructed as 
to which of the three entrances was to be used by that group. As 
each child entered the classroom he was required to check his atten- 
dance and request for milk and hot lunch on a chart devised by the 
consulting teacher. This procedure was specifically designed to re- 
duce group time spent In non-academic tasks. 

Prescription .packets were compiled daily for each child. These pack- 
ets contained a prescription sheet listing the child^s assignments 
as well as the areas of the room and the time for working on each 
assignment. These were helpful to the teacher In determining exactly 
where each child was In academic areas. Also contained in the packet 
were the previous day's corrected papers and fun sheets. This pro- 
cedure was designed to reduce time spent in distributing work mater- 
ials and moving to and from work areas. 



Measures 



taking roll call for attendance. 

("b^ recording requests for milk and 
hot lunch. 




work materials . 




moving to and from work areas. 



A point system was established which allowed groups of five children 
to earn free time at the end of each academic block. The teacher di- 
rected one child in each group to record points for the entire group 
when they emitted the following behaviors: 



Behavior No. of Points 

•a) moving from one activity center 
to another within two minutes. 

•b) no talking above a whisper when 
^ moving. 

•c) having necessary materials ready 
(pencils y paper, books y work- 
sheets). 

•d) face oriented towards teacher, 

materials, or peers. 

\ 

•e) raising hand for teacher, 
•f) waiting quietly for teacher. 



If at least ten points were earned during the specified academic ac- 
tivity time the children were allotted five minutes of free time to 
select a game or continue to work on their packets. Groups with fewer 
than ten points remained working at the subject area with their teach- 
er. This procedure was primarily designed to increase individual in- 
volvement in academic tasks. 



Results 

Figure 1 represents a record of* group time spent in non-academic ac- 
tivities during a two-hour period on consecutive school days. During 
baseline conditions minutes of non-academic time ranged from 25 to 31 
minutes. As you can see, this is about one fourth the time spent in 
non-academics. During the experimental condition when prescriptive 
packets, points and free time were inst*rtuted, minutes of non-aca- 
demic time dropped from four to nine minutes. This level was main- 
tained during subsequent postchecks taken at bi-weekly intervals. 
The consulting teacher aide recorded minutes of non-academic time on 
one occasion during each condition. 



® 
® 
® 

© 

® 
® 



m\Hi cuss 



5 
-f 

z 
o 
z 

lii 



50r 

I 



40 



30 



20 - 



10 



Baseline 




i i i i t 



O Second Observer 



Seir-ChaHlng. Prescription Packets 
and Contingent Points 



Post 
Ctiecks 



i — i — i — i lb A i^i ^ 



DAYS 



Fig. I. Minutes of group Involvement In non- 
academic tasks during two-hour sessions on con- 
secutive school days. 



DISCUSSION 

The Open Space Environment facilitated frequent observation of the re- 
ferred class by other teachers in the building. These teachers were 
anxious to develop similar procedures in their area% and requested 
our services. 

Once the overall nwnagement problems were remec »vVd, the teachers 
could then identify children with behavioral deficits. Thus, as a re- 
sult of the work in the referred classroom, teachers referred thirty 
individual children for consulting teacher services within the next 
few weeks. 



Since this time, points have been removed and prescriptive packets are 
written together with the child on a weekly and contractual basis. It 
is no longer necessary to use free time as a reinforcer since children 
have become increasingly more involved in clioosing and successfully 
carrying out their own programs. 
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O IMPROVING 'MATH PERFORMANCE OF AN EIGHT-YEAR-OLD GIRLQ 

Referral 

Barbara, an eight-year-old girl, was one of ^5 children In a third 
year open classroom. Her teachers described her as a highly emotion- 
al child, with severely deficit academic skills. Initially, Barbara 
was referred because of incomplete assignments and slow progress in 
mathematics. 



Measures 

Daily measures consisted of computing the percent correct of Barbara^s 
daily mathematics assignments. The teacher recorded the data daily. 

To insure reliability of these measures a second observer occasion- 
ally scored the same assignments on at least one occasion duriog each 
condition. 



Proaednre 

After Barbara received her daily mathematics assignment the teacher 
monitored the completion of the first three problems. The first prob- 
lem was done entirely by the teacher in Barbara's presence. The sec- 
ond problem was done cooperatively by both the teacher and Barbara. 
The third was done by Barbara in the teacher's presence. Barbara then 
continued by herself until the paper was completed. Upon completion, 
\the teacher corrected the assignment immediately. If the paper was 
between 90% and 100% correct, Barbara would take the paper and a card 
to the. principal 's office for a private conference. If he was not In 
his office the index card was left on his desk. This was a signal to 
the principal to visit Barbara in her classroom for their conference. 



Results 

During baseline, when the procedure was not employed, the percent cor- 
rect of mathematics responses ranged from 0% to 100%. When confer- 
ences were initiated, the correct increased to optimum levels. Agree- 
ment between observers was 100%. 
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Fig. 2. Percentages of correct math re- 
sponses during consecutive daily- sessions. 



-^IMSCUSSION 



The teachers reported that Barbara now seems eager"- to do her work 
well. She has asked If she might have a similar program for read- 
ing. The teachers are most eager to expand such a program for the 
entire day. 
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Oreducing verbal aggressions of a ^th grade boy© 

Referral 

Alan, a nine-year-old boy, was one of 62 children in a fourth year 
open spaced classroom* He was referred because of his reported verb- 
al aggressions toward other children. 



Measures 

Verbal aggression was defined as any loud abusive statement such as 
*^Shut up,*' or "Mm going to get you after class," directed to another 
child. The number of verbal aggressions was tallied by the teacher 
during this half hour session each day. At the conclusion of the 
daily session the total number of aggressions was recorded. 

To insure reliability of these measures, the consulting teacher oc- 
casionally served as a second observer iDn at least one occasion dur-- 
ing each condition. 

Procedure 

Alan was given a data recording sheet similar to that used by his 
teacher, it was explained that he and his teacher would be charting 
his daily behavior during a specified time period. A criterion of no 
more than two instances of verbal aggressions per session was set. 
At the completion of the half hour period, Alan and the teacher com*- 
pared data. If the number of tallies did not exceed two on both the 
teacher's and Alan^s data sheet a card was sent home stating that 
Alan had been a cooperative student that day. 



Results 

During BASELINE I and BASELINE 2, when the procedure was not employed, 
the number of verbal aggressions ranged from two to seven during the 
daily half hour session. During Contingency 1 and Contingency 2 when 
Alan began recording his own data and receiving a card to be taken 
home, the number of verbal aggressions ranged from zero to two. Agree- 
ment between observers was 100% 
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Fig* 3» Number of verbal aggressions dur- 
ing consecutive daily 30-minute sessions. 



DISCUSSION 

The teachers were so pleased by the results that they decided to use 
this procedure throughout the' entire day. They have divided the day 
into two periods: morning and afternoon. Alan is currently taking^ 
data for the entire day and can earn one card for each period. Addi- 
tionally, the teachers have decided to lower the criterion to one in- 
stance of verbal aggression per period. They hope to reduce the cri- 
terion to zero in the near future. 
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OiNCREASING PARTICIPATION, WORK COMPLETION, AND ACCURACY BEHAVIOR 

IN A GIFTED THIRD GRADERQ 



Referral 

Kathleen, an eight-year-old girl, was one of ^5 children In a third 
year open space classroom. She was referred because she had recently 
transferred to the school and was not performing at her reported po- 
tential . 



Measures 

Daily measures Included the percentage of assigned tasks completed 
during the entire school day, as well as the percentage of completed 
and correct math responses during a dally 30-mInute session. 

To insure reliability of these measures the consulting teacher occa- 
sionally served as a second observer on at least one occasion during 
each condition. 



Procedure 

An Individualized prescription packet was designed for Kathleen which 
contained a schedule of tasks as well as work materials for the day. 
Difficult tasks, such as mathematics, were scheduled to be completed 
first during a 30-mInute period. An Index card which had the numeral 
corresponding to the r>umber of assignments for that. day was given to 
Kathleen. After she completed each task on the prescription sheet 
she raised her hand and her teacher checked to see if the work was 
completed. If the total number of points equalled the numeral on the 
card she earned the card. 

The teacher then wrote a message to the parents such as, ^'Kathleen 
has completed all of her work today." This card was then given to 
Kathleen to take home to her parents who had agreed to place the card 
on the refrigerator and to spend extra time with her expressing their 
satisfaction with her performance at school. 



Results 

During BASELINE I and BASELINE 2, when the procedure was not employed, 
the measured behaviors were low. During Contingency 1 and Contingen-- 
ay 2^ when prescription packets and teacher/parent praise were in ef- 
fect, the measured behaviors rose dramatically. During Contingency 2 
the behaviors were maintained at optimum levels. Agreement between 
observers was 100^. 
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Fig* 4a. Percentages of complete tasks during consecutive 
days. 

Fig. 4b. Percentages of complete math responses during con- 
secutive daily sessions* 

Fig. 4c. Percentages of correct math responses during con- 
secutive daily sessions. 



DISCUSSION 



The teachers have reported that Kathleen is now progressing at an 
accelerated rate in all of her subjects and that this type of struc- 
ture IS beneficial for children in an open classroom. 
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Oelimination of belligerent and truant behavior 
IN TWO pre-delinquent boysQ 

Referral 

The subjects were two boys in a sixth year open space classroom, in 
which there were 69 children and three teachers, 

George was referred because of 'failure to do his assignments and re- 
fusal to comply with teacher requests. For the past five years 
George had been living with foster parents. 

Jack was referred as a result of his truant behavior and his general 
attitude of non-compliance. He had been referred on several occa- 
sions to juvenile authorities for attempted arson and theft. 

Both boys were several years below grade level in academic subjects* 



Measures 

Participating behavior was defined as face oriented toward teacher 
and/or assigned materials. This behavior was observed at three minute 
time samples during the same half hour period each day. Days on which 
the boys completed assignments were also recorded. 

To Insure reliability of these measures the consulting teacher occa- 
sionally served as a second observer on'at least one occasion during' 
each condition. ^ 

Procedures 

Individualized prescription packets were designed for the boys^. They 
included a schedule for the day and assignments from such materials 
as Sullivan Programmed Math and Reading ^ The New Practice Readers^ 
Reading for Comprehension and individually planned units in social 
studies and science. Activities such as recess, music, lunch and 
physical education were also on the daily prescription sheets. 

Upon completion of each assignment the teachers Initialed a card in 
the prescription packet. If the entire packet was completed the ini- 
tialed card was sent home. Two completed cards earned a conference 
with a consulting teacher. Six completed cards earned a trip of their 
choice with a consul ting "teacher. Trips earned thus far include a 
canoe trip, hockey game, movies, lunch at McDonald's and a visit to 
the pol ice station. 
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Results 

During BASELINE I and BASELINE 2, when the procedure was not employed, 
Jack's percentage of participating time ranged from 0% to 100^ and 
George's also ranged from 0^ to 1001 per half hour session while task 
completion was variable* During Contir. .,.ay 1 and Contingency 2, the 
boys' percentage of participating time maintained at 100% and tasks 
were completed consistently. 
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Fig. 5a. ^Percentages of participation 
time during dally 30-minute sessions. 

Fig. 5b. Tasks complete or Incomplete 
during consecutive days. 
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Fig. 6a. Percentages of participation time dur- 
ing daily 30-fninute sessions. 

Fig. 6b. Tasks compH^ete or incomplete during con- 
secutive days. 



DISCUSSION 

Teachers and administrators have reported that both boys are now model 
students. They have suggested expanding the program to include behav- 
iors such as smiles, conversing with adults and sharing with peers. 

A measured decrease in the number of the boys* verbal refusals was al- 
so reported, but there was no measure of the number of teacher requests 
that woulid occasion verbal refusals. 

Currently the schedule of reinforcement is being thinned. 
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Integration of 
normal 8t handicapped children 

IN A 

BEHAVIOR MODIFICATION PRESCHOOL: 

A CASE STUDYI 

k. eileen alien 
paulette m. benning 
IV. thomas drummond 

Recent research at the Experimental Education Unit (EEU) Model Pre- 
school includes a pilot study of the effects of a 50-50 enrol Iment mix- 
ture of 16 ^'normal" and handicapped children in a preschool class. 
Procedures for studying this and related questions are still gross^ al- 
though we have published some tentative findings (Allen, Turner, and 
Everett, 1970)* Nevertheless, we are still "feeling our way'* and have 
few definitive answers about our eventual methodology. One of our 
first efforts is to collect comprehensive data on a number of normal 
and atypical children, using a data system that enables us to look at 
the '^whole child," We think we are beginning to get some clues. For 
example, in the case study that follows, the data indicate that mere 
integration in a group composed of 50% normal peers did not eliminate 
all of the emotionally disturbed child's maladaptive behaviors. Spe- 
cific intervention procedures were required for several behaviors while 
several other beha/iors showed spontaneous improvement. Because we are 
interested, too, in ascertaining how much- data-taking a supervising pre- 
school teacher can manage, v;e cite this case study because it also 
speaks to this question. 



SUBJECT AND SETTING 

> 

Julie was three years and eleven months old when she was enrolled in 
the Model Preschool, She was an unusually small child for her age 
though there were no untoward medical signs except that of arrested hy- 
drocephalus in early infancy. The medical follow-ups indicated no evi- 
dence of subsequent physical or neurological impairment. Developmen- 
tal ly, she exhibited poor large motor skills and infantile speech pat- 
terns. In addition, she displayed an extensive repertoire of inappro- 
priate and maladaptive social behaviors toward children and adults. 
With children, her most conspicuous responses were avoidance or attack. 



This paper was presented <jt The Third Annual Conference on Behav- 
ior Analysis in Education '-t the University of Kansas in Lawrence, 
Kansas, May, 1972, The Model Preschool Center for Handicapped Children 
is funded in part through P, L, 89-230 Title VI, Part C, Sec, 623, 
Or, Alice H. Hayden is the Project Director; Dr, Norris G, Haring is 
the Co-Di rector. 
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With adults, she was totally noncompl lant. She screamed ''No'^ to any 
request, however mild; any Insistence by an adult (parent or teacher) 
provoked a full-fledged tantrum In which she threw herself face down 
on the floor, kicking and screaming hysterically. 

Her previous school placement had been a preschool for emotionally dis- 
turbed children in the psychiatric department of a children's hospital. 
The staff there felt that Julie had made some progress but that she 
might progress more rapidly if she could interact with a more normal 
- peer group than was available in the hospital preschool setting. Two 
members of the EEU preschool staff observed Julie in the psychiatric 
setting and they agreed to enroll her in a preschool class at the EEU. 
In this class were 16 children, half of v/hom were classified as normal, 
the other half as handicapped. The handicapping conditions varied: 
emotional disturbance,^ mental retardation, orthopedic involvement, lan- 
guage impairment. Classroom personnel were a head teacher, an assis- 
tant teacher, and an intern advancing a master's degree in special edu- 
cation. Several other adults were in the classroom each quarter — stu- 
dents from various disciplines for whom the preschool staff provided 
graduate and undergraduate training. 



PROCEDURES 

The basic Washington Social Code (Bijou, Peterson, Harris, Allen, and 
Johnston, 1968), with a number of variations, was employed as the data 
system. Data were recorded at 10 second intervals for 20 to 70 minutes 
during free-play indoors. Length of sample time varied with the amount 
of personnel on hand each day. Specifically, data were collected on: 

•(1)* quality of social behavior, indicating whether 
the child was engaged in cooperative, parallel, 
or isolate play; 

•(2)* amount of verbal behavior with peers; 

•(3)* amount of time not engaged in purposeful activ- 
ities (e.g., wandering, watching, rocking or 
thumbsucking, apart from a play activity or ma- 
terial); 

•(^)» amount of disruptive behaviors such as scream- 
ing, having a tantrum, running off with other 
children's possessions; 

•(5)# number of attacks (kicks, hits, or bites) that 
made physical contact with another child; and 

•{(>)• amount of teacher attention, defined as any In- 
terval in which a teacher touched, spoke to, or 
presented Julie with material of any kind. 
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Six days of baseline data were collected; on the fifth day a new cate- 
gory of maladaptive behaviors was added: throwing and dumping play 
materials and equipment.' 

At the end of six days, the head teacher declined to continue baseline, 
arguing convincingly that Julie's steadily Increasing disruptive behav- 
iors and ever more ferocious physical attacks were interfering drastic- 
ally with the other 15 children's school program. Several of these 
children were three-year-olds adapting to their first group experience* 
Experimentalists engaged in classroom studies know how imperative it is 
for successful research to have the teaching staff agree to the experi- 
mantal procedures. It is sometimes necessary to be less rigorous than 
one would like in order to maintain teacher cooperation. Thus, a com- 
promise was reached and Phase I commenced. 

Phase I 

The intervention tactics used In Phase I were a compromise, as mentioned 
above, between the experimenter's wish to achieve a more stable baseline 
and the teachers' Insistence that something had to be done. After exam- 
ining several possibilities the teachers agreed to operate negatively 
on only one behavior — the one they felt was most traumatizing to the 
other children — Julie's physical attacks. She was to be put in time-out 
for each attack. They contrived a time-out spot by placing two sets of 
heavy lockers in a partially closed "V** position. When the child was 
put in time-out, the "V" was pushed to a fully closed position, provid- 
ing complete isolation within the classroom setting. Two more categories 
of data were added: amount of time Julie spent In time-out and amount 
of tantrum time durln^^ time-out.. Another revision was made in the ex- 
perimental procedures: the teacher collecting the data acted as the time- 
out agent 'to Tnsure that every physical assault received an Immediate 
negative consequence. This teacher also dispensed positive reinforcement 
according to routine procedures in effect for all children — intermittent 
social reinforcement of appropriate behaviors. (In Julie's case, bare 
approximations to appropriate behaviors received positive reinforcement.) 
All other disruptive behavlors--dumping, throwing, snatching, screaming 
and having tantrums--were ignored so far as possible. A series of lan- 
guage sampling observations was also scheduled at this time in order to 
assess potential qualitative improvement In Julie's verbal repertoire. 

Phase II 

The second set of intervention procedures, labelled "activity decision 
required,'^ was aimed at reducing Julie's random wander Ings about the 
room. The staff agreed that she most often engaged in disruptive behav- 
ior or physical assault during her aimless cruising. These procedures 
were used: each time Julie left an activity she was required to state 
where she was going to play n^xt. Usually the teacher offered two or 
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three suggestions: "There is room for you at the easel, or you can go 
to the puzzle t.able, or play with the blocks.*' If Julie refused to 
state a choice /she was led to the locker area, but not put in time-out. 
The teacher stood with her back to Julie, preventing her return to the 
main play area until she indicated verbally where she would play. Such 
decisions were heartily reinforced by the teacher who then accompanied 
Julie to the area of her choice and helped her to get started in play. 
Every effort was made during this period to teach Julie how to use play 
materials, for she had not even rudimentary skills with blocks, manipu- 
lative toys, creative materials, or dramatic play act ivi ties . Time-out 
for physical aggression was still in effect during Phase II. 



Phase III ^ 

Jul ie's throwing and dumping of play materials continued to be a major 
disruption in the classroom. One reason, of course, was that while 
teachers could do a heroic job of ignoring her, it was almost impossible 
to prevent peers frol reinforcing Jul ie with negative verbalizations 
when she swept their half-finished puzzles off the table, dumped the 
contents of their paint cans on the floor or on them, or poured water 
over their sleeping dolls. In fact, argued the teachers, Julie was be- 
coming so aversive to all the childr.en that it would take until Dooms- 
day for her to be accepted as a member of that peer group unless further 
steps were taken immediately to reduce her obnoxious behaviors. Thus 
Phase iJr--time-out for all throwing and dumping episodes in addition to 
Phase I and Phase II conditions: 

(l]^ timing-out physical attacks; 

(2]^ ignoring screaming and tantrums; 

(3)^ requiring a play-choice decision; 

intermfttent ly reinforcing approximations to 
appropriate play; and 

(S^teaching use of play materials. 



Phase IV 

Because the children continued to shun Julie, a fourth phase, structur- 
ing cooperative play activities was instituted to insure that Julie 
would be included. For example, certain children were designated to 
play with her for part .of the free-play period in a particular area: 
"John and Julie and Sara and Shel I i are to play in the housekeeping cor- 
ner." The rationale for this phase was the expectation that children 
who were temporarily legislated to play with the semi -reformed Julie 
would discover that she had shed many of her aversive properties, and 
that teachers thus would have the opportunity to reinforce Julie for ap- 
propriate play with peers and to ^^inforce the children for playing co- 
operatively with Julie. 



131 

RESULTS 

Baseline Period 

During baseline, Juliets physical attacks on children ro^e to a high 
of 68 during one 60-minute observation period (Figure I), while throw- 
ing and dumping episodes reached a peak of 7^ (Figure 2A) . Disruptive 
behaviors rose to (Figure 2B) ; the amount of time not engaged in 
purposeful activities climbed steadily to 88^ (Figure 3). Amount of 
verbalizing, to peers was negligible, the high being 6% (Figure 4A) . 
Cooperative interaction with peers reached 301, but was declining 
steadily, and amount of^ time spent alone was as high as 77^ (Figure 4B) . 
Teacher attention to Julie averaged \S% during the baseline period 
(Figure 5). 



Phase r (time-'Out for physical attacks) 

Time-out for physical attacks resulted in an immediate and drastic de- 
crease in attacks. Over the five-day Phase I perfod, the- range was two 
to seven episodes (Fi.gure I). Concurrently, throwing and dumping epi- 
sodes decelerated to a low of five episodes in two observation periods 
(Figure 2A) . Juliets disruptive behaviors also decreased markedly to a 
low of four episodes (Figure 2B) . (Neither of these behaviors, it must 
be remembered, was under treatnent during Phase J.) Amount of time not 
engaged in purposeful activities dropped to 3k% on one day (Figure 3); 
however, much of Julie's time was spent in time-out during this period, 
so that she had much less time available to her for *'cruising." Ver- 
balizations to peers increased slightly to ]2% (Figure 4A) ; cooperative 
interaction with peers remained at approximately the same average, 2S%y 
v/hile isolate play decreased (Figure 4). Again, this decrease was 
largely due to the time Julie was spending in time-out — she simply had 
less time at her disposal for isolate activities. Teacher attention to 
Julie in Phase I increased slightly to an average of 2k% (Figure 5) 
mainly because of the number of times teachers took her to the time-out 
area; the amount of time Julie spent in time-out ranged from 7% to 301 
per Phase I session (Figure 6). 

Phase II (activity decision required) 

Even though Phase J produced a decrease in several of Julie's undesir- 
able behaviors, the teachers were concerned about how much time she 
spent cruising about aimlessly when not in time-out. Therefore, 
Phase II was initiated, requiring Julie to state where she would play 
next and keeping her hemmed in a corner of the room until she did so. 
Teachers also continued the Phase I conditions of time-out for physical 
attacks, ignoring all disruptive episodes and intermittent positive 
social reinforcement for appropriate behavior. As can be seen in 
Fiqure I, physical attacks dropped to a near zero rate and stayed there. 
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Fig. I. PHYSICAL ATTACKS. Phase IV data are collapsed 
into 5-day units. The median data point of each unit is 
p lotted. 

However, "^Jul ie*s throwing and dumping episodes rose sharply, reaching 
a peak of 56 episodes on one day (Figure 2A) . Disruptive episodes con- 
tinued at roughly the Phase I low rate (Figure 2B) . During the first 
nine days of Phase II percentage of time not spent in purposeful activ- 
ities was very high, from S0% to 65% (Figure 3). None of this was 
cruising time, however; it was time Julie spent in the corner deciding 
where to play next* Over the next nine days of Phase II y the amount 
of time not in activities varied markedly, although on four days she 
spent 10^ or less of her time not engaged in activities (Figure 3). 
Since she was spending so much of her time in a corner of the room dur- 
ing these first nine days, verbal behavior and cooperat ion^wi th peers 
dropped sharply but both showed good increases during the latter half 
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Tlirowiiii and Dmnpiif 



■ASELIME^HASE 1 ^HAtE 2 ^HAtE 3 ^HAtE 4 




DAYS 



Fig. 2. A, Upper Graph. THROWING AND DUMPING. 

B, Lower Graph. DISRUPTIVE BEHAVIORS. 

Phase IV data are collapsed Into 5-day units. 
The median data poirit of each unit is plotted. 

of Phase 77— especial ly verbalization to peers: it rose to 25% on one 
day (Figure 4A and 4B). Teachers did not give Julie any attention when 
she was hemmed into the corner except for periodic cues to her to tell 
them where she would next play; therefore, teacher attention, except 
for the first part of Phase II vjbs only a little greater than the typi- 
cal Phase I rate (Figure 5). Julie also spent some time in actual time- 
out after making a physical attack on another, but this seldom went 
above 10% for any day except for one or two "bad days" (Figure 6). 



Time Not in Activities 




J 



DAYS 



Fig. 3* TIME NOT IN ACTIVITIES. Phase IV data are 
collapsed into 5-day units* The median data point 
of each unit Is plotted. 

Phase III ( time-out for throwing and dumping) 

Because Julie's throwing and dumping episodes were much too frequent dur- 
ing Phase 11^ the teachers decided on the negative consequence, time-out, 
for these responses. It produced an immediate and stable decrease to a 
zero rate which Julie maintained for the rest of Phase III (Figure 2A). 
Physical assaults (still subject to time-out in this phase) stayed at a 
near zero rate (Figure I); other disruptive behaviors also dropped to 
and stayed at that rate (Figure 2B) . Verbalizations to peers remained 
at a fairly good level--from 5% to 18^ per day; cooperative interaction 
dropped to a little less than its former level. Isolate play, however, 
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Fig» 4. A, Upper Graph. VERBAL TO PEERS. 

B, Lower Graph. SOCIAL BEHAVIOR. 

Phase IV data are collapsed into 5-day units. 
The median data point of each unit is plotted. 

decreased considerably, indicating that Julie was spending much more 
time near other children or in parallel play with them (Figure 4A and 
4B) . Teacher attention increased during Phase II to an average nf 23% 
per day (Figure 5). After an initial increase in time-out5^cr tiirow- 
ing and dumping, there were no time-outs at all during the last seven 
days of the phase (Figure 6). 
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Teacher AtteRion 
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Fig. 5. TEACHER ATTENTION^ Phase IV data are 
collapsed into 5-day units. The median data 
point of each unit is plotted^ 

2 

Phase IV (structuring cooperative play) 

By the end of Phase III, Julie, according to the teachers* judgement, 
was not engaging In a sufficient amount of cooperative p\piy* They be- 
gan, therefore, to actually structure at least one situation per free 



2 

Phase IV data are collapsed into 5-day units for more economic 

display; the median of each unit appears on the graphs^ The expanded 

data are available, however. 
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Fig. 6. A, Upper Graph. TIME IN TIME-OUT. 

B> Lower Graph. TANTRUMS IN TIME-OUT- 

Phase IV data are collapsed into 5-day units. 
The median data point of ^each unit is plotted. 

play session in whicK they instructed Julie and several other children 
to play together in a specific activity. They made io requirements 
about the length of "legis lated*' interaction. This program did not in- 
crease Julie's cooperative play appreciably, although on several days 
she did go above 25% (Figure 4B) . Hov/ever, the amount of isolate play 
decreased markedly, indicating that Julie was spending a great deal of 
time in proximity to children — a good first approximation to cooperative 



interaction. Her verbalization rate also continued at an appropriate 
level (Figure 4A), although there was some fluctuation. 

During Phase IV, Julie's physical attacks stf/ed at a near zero rate 
(Figure !) as did her throwing and dump ing_:(^1gure 2A) and disruptive 
behaviors (Figure 2B) . Time not in activitira- staved well below 10% 
except for one day (Figure 3). In this phase, teachers discontinued 
the decision-making contingency. Teacher attei'T-ion averaged 23% 
(Figure 5) although several children were ^hap^lng in this attention 
since cooperative play was to receive adult social reinforcement". The 
time Julie spent in time-out was little (Figure 6A) though it was still 
required occasionally. She'lio longer had tantrums in time-out, however 
(Figure 6B) . 

Three inter-rater reliability measures were obtained during the study 
one in October, one in November, c*nd one in January. The scores on 
these were 91%, 9U, and 90% respectively on total number of correctly 
matched response units.. 



DISCUSSION AND CONCLUSIONS 

Though Juliets disruptive and physical iy aggrt ive behaviors were at 
a low level during her first few days in the c assroom, these began to 
appear at an, accelerating rate once she was thoroughly adapted to the 
new situation. The teachers* anxieties over the other children's well- 
being led to abandoning one of the experimental objectives, that of as- 
certaining the effect on Jjlie^s overall behavior of simple exposure-to- 
a inore normal peer ^rojp. It seems unlikely, however, that she would 
have improved without specific intervefvt+on;| she was simp'ly too aversive 
to both children ami-adults* Because of herj avers iveness, of course, 
most social reinforcement from peers was directed to her undesirable be- 
haviors. It is"very dif f icu'lt to get a -group of preschool children to 
reinforce differentially a c ild y^rith^ Ju 1 ie ' s repertoire, especially 
when half of the ch-i'ldren are themselves management problems. Further- 
more, even if the teachers had been willing to program the children to ^ 
do so, the extinction of Juliets maladaptive responses woilld probably 
Have been too slow and arduous a process. 

After taking baseline data, the teachers chose one behavior- aggress ive 
physical attacks--as a first target behavior to modify. However, data 
were continuously kept on many other responses in order to ascertain 
what, if any, correlated changes might occur. Thus, a multiple haseline 
design was employed in that baseline data on certain behaviors (^^isrup- 
tive responses and verbal behavior to peers) were kept throughout ^the 



"Amount of proximity can be obtained by combining amount of coopera 
tive and isolate responses and subtracting from 100 for each data point. 
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study while other behaviors (time not in activities, throwi'ng and dump- 
ing and cooperative play) were removed one at a time from baseline as 
phase changes were made. It is interesting that while throwing and 
dumping and disruptive behaviors decreased during Phase I (time-out for 
physical attacks) | the rate of throwing and dumping increased again with* 
in a few days though an increase of disruptive acts did not occur. In 
fact, these last responses disappeared almost entirely in the course of 
treatment even though they were never subjected to specific intervention. 

In addition to the behaviors classified as disruptive-, one other behav- 
ior, never exposed to specific intervention, Julie's verbal interaction 
with peers, showed marked improvement. Not only did amount of verbali- 
zations increase spontaneously, quality al^'owas somewhat improved. 
These qualitative changes are documented in a series of language samples 
taken on the child during the course of the study. 

Another prediction, that Julie*s rate of cooperative play would increase 
spontaneously once she became less aversive to children and had acquired 
some play skills, was not borne out. A specific program (PMse IV) was 
required to achieve that goal. Even then, the quantitative rate of in- 
crease was not remarkable, although the improved quality of her interac- 
tion with peers was noteworthy. These impro^'ements are readily observ- 
able on a series of videotapes that span the study from start to finish. 
These tapes have been assembled into a video case study to provide addi- 
tional documentation of the dramatic changes in Julie*s behavior. 

This study, as well as several others in progress, seems to indicate that 
children with severe problem behaviors are not likely to improve without 
specific intervention. With specific intervention, however, it appears 
that progress is rapid where there are normal peers to serve as models 
for app^'opriate behavior. Also, the "cost" in teacher time would seem 
reasonable. In Julie's case it exceeded by very little the typical a- 
mount that children receive in a well-staffed preschool. Thus, it may 
be assumed that other children are not being "shortchanged," Pata on 
thr* normal children indicate steady progress with no deleterious side 
effects. Additional favorable evidence appears in their parents* re- 
sponses to the program. Without exception, all parents asked for a sec- 
ond yearns enrollment for their child, or for a younger sibling if the 
older child was at kindergarten age. 

Finally, this study yields some tentative answers to the question, "Can 
teachers realistically be expected to take data, program for, and manage 
so diversified a group?" In this study, the head teacher collected much 
of the data while supervising in the classroom. Such a dual role has 
been cai^ried out by teachers in other studies (Turner, Allen, and Smith, 
1972,'^'in press); therefore, data collection by the teacher is not unique. 
However, teacher-collected data are usually simple counts or duration 
measures of fairly discrete events whereas the data system for this study 
was much more complex, - *The teacher recorded 11 aspects of the child's 
behavioral repertoire per 10-second interval over a 20- to 70-minute 



observation period each day> thus making 120 to 420 recorded obs^va- 
rions during each class session. 

Another noteworthy feature of this study documented vividly on video- 
tape is that in addition to supervisory and recording duties, the data- 
taking teacher also acted as the reinforcing agent for- Julie. That is, 
the data-taking teacher dispensed much of the positive social reinforce- 
ment for Juliets appropriate behavior and served as sole agent for imme- 
diately putting the child In time-out for the designated inappropriate 
responses. It might be underscored that one of the reasons for assign- 
ing the recording tea cfcier-^^te— t4>4:^^add Ht4ona 1 duty was to Insure an imme- 
diate negative consequence. The other adults in the room, engaged in 
wo'^king with the other 15 children, often failed to see Julie's undesir- 
. )le response or could not disengage themselves from an activity they 
were Involved in rapidly enough to provide immediate negative feedback. 
There was some concern, in i t la 1 1y, that the recording teacher's addi- 
tional role of reinforcing agent would yield much lov^er inter-rater rel i 
ability, but this fear proved unfounded. 

While it cannot be stated definitively how and in vthtt numbers to com- 
bine normal and handicapped children In a single classroom, a series of 
studies such as the one described in this paper should provide a founda- 
tion for designing a long-term, comprehensive research program to fer- 
ret out the answers. Answers are needed, for we do handicapped children 
a severe injustice if we keep them out of the educational mainstream. 
Grouping atypical children together, segregating them from normal peer 
models, often seems to increase their atypical behaviors. Behavior anal 
ysis has demonstrated that it can help to remediate many behavior prob- 
lems; surely it can be expected to yield empirical data that will help 
meet the urgent need to better educate handicapped children. 
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PROGRAMS & TECHNIQUES IN 
BEHAVIOR ANALYSIS: 

A Comprehensive Behavior 
Analysis Program for Handi- 
capped Chilaren 




A COMPREHENSIVE 
BEHAVIOR ANALYSIS PROGRAM 
FOR HANDICAPPED CHILDREN 



INTRODUCED BY: ihn n thomas 

The following set of five papers was produced in the 
Child Behavior Laboratory School at the University 
of Illinois. As a group, the papers focus on the 
systematic application of behavioral principles to 
the social and academic problems of children discard- 
ed by the public school System. 

# 

The first paper, by G^tonm and BijOU, introduces the 
Lab School's program and provides detailed descrip- 
tions of the subject population, the school^nvi ron- 
ment and the research strategy. Next, BeAnQA~"Brr6 
G^ibnm present the program used to teach oral reading 
and comprehension skills. In addition, this paper 
details the types of data used to evaluate the pro- 
gram and to provide information for further program 
development. Finally, the paper briefly presents da- 
ta on the use of the reading program by a mother in 
her own home. The third paper in this group, written 
by Ratjzk and Me44e£Aoad, focuses on the development 
of three interdependent instructional programs. The 
research on teaching writing, spelling, and composi- 
tion is presented in terms of the analysis of tasks 
to be taught and the procedures which wi-l I enable the 
children to master those tasks. The fourth paper, by 
PaxhOii^, covers the analysis of arithmetic behavior 
as mani pu I atXv.e operant behaviors and reviews the de- 
velopment of an effective arithmetic program. Final- 
ly, GnXjnm summarizes the implications of the preced- 
ing papers. 

As a set of readings, the papers clearly suggest that 
a body of replicable techniques is under development 
for managing the setting events, academic stimulus 
materials, and teachers' behaviors which make up the 
child's learning environment. Clearly, psychology 
has . someth ing to offer education — nowl 
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Principles and objectives 

IN AN 

ACADEMIC PROGRAM FCR^ 
YOUNG HANDICAPPED CHILDREN^ 

Jeffrey a. grimm 
Sidney w. bijou 

One of the children Enrolled in the Ch i Id Behavior Laboratory class 
once commented to his teacher about his difficulties, **l think I have 
my thinking cap on backwards." A science of human behavior that con- 
centrates upon hypothetical processes may one day develop a cognitive 
hat that can be rearranged on the child's head to remediate the child* 
problem behaviors. However, behavior analysts have chosen not to wait 
and have insisted that there is n# need to invent the cognitive hat. 
Instead, research efforts have been aimed at the arrangement of the 
classroom environment to promote progressive changes In the child's 
behavior toward desirable school objectives. 

In the research to be presented, empirical behavior principles have 
been applied to the development-of-procerfures and materials for the 
remedial teaching of young retarded and emotionally disturbed school 
children. A more comprehensive description of the program has been 
reported elsewhere (Bijou & Grimm, in press) • As introduction to the 
following papers on the programming of cognitive school subjects, we 
shall describe: 

* 

the types of children studied; 

the classroom situation in which the research 
takes place; and 

the nature of the research. ~ 

f" 

SUBJECT POPULATION 

The children, ranging in age "from five to eight and coming from a 
variety of socio-economic classes, are referred by schools in Cham- 
paign County, Illinois. They are viewed as severe behavior problems 
or extreme learnimg-irfiTabi 1 i ty cases neither of which the public 



The research described here and in the papers by Grimm and 
Berner, Parsons, and Rayek and Nesselroad is supported by the U.S. 
Office of Education, Division of Research, Bureau of Education for 
the Handicapped, Project No. 23-3030, Grant No. OEG-0-9-232030-0762 
(032). 
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schools feel equipped to handle. These behavior problems can be 
grouped into three broad categories: behavioral excesses, behavior- 
al deficits, and inappropriate stimulus control. 

Behavioral excesses,.' commonly called conduct problems, are displayed 
by aggressive, extremejly disruptive, destructive, or hyperactive \ 
cTii ldren. The ch i TdHs 'usual ly off^task, engaging in a high rate ^ 
of inappropriate, non-academic behaviors or changing activities fre- 
quently. Examples include physical or verbal threats directed at 
other children, destruction of books or other academic materials, 
and running around the classroom or climbing on furniture. Children 
with behavioral deficits include the withdrawn or isolate child, the 
child who does not talk, and the child who does not have the precur- 
rent behavi ors for academic endeavors. Example% of the latter are 
^ -Inability to imitate speech sounds accurately and inability to appro- 
priately manipulate academic materials such as pencils, erasers, or 
pages in a book. The third category of behavioral problems dis- 
played in the classroom, inappropriate stimulus control, refers to 
behaviors that occur frequently but under inappropriate circum- 
stances. Examples are crying in response to mild frustration and 
subtle ayersive cues, strong dependent relationships with the teach- 
er, and inept play behavior. \ 

Children are ordinarily enrolled in the Laboratory class for the 
nine month schooTyear. In some cases, this is shortened to as lit- 
tle as four months and rn others it is lengthened to two successive 

academic years. The objective for the exceptional child is to pro- * ^ 

vide him with academic and social skifls that enable him to return 
to a class in the public schools. 



THE CLASSROOM SITUATION 

The classroom envi rOTment includes the physical arrangement of the 
classroom, the structure of the class day, the behavior of the teach- 
er and her aides, the behavior of the children as a class group, and 
the nature of the instructional materials and procedures. The class 
itself contains desks for each of the children and has a number of 
quiet work areas and a small playroom. Maximum class size is eight 
children. The teaching staff consists of one teacher, one assistant 
and a number of tutors. An extended description of the LaboVatory 
class can be found in Bijou (in press). 

Three classes of environmental evenTs are systematically maliaged. 
The first class is composed of etting or contextual events. These 
include establishment and maintenance of a positive emotional tone 
in the classroom, a flexible sequence of study periods, and the phys- 
ical arrangement of the classroom. If necessary, the child's initial 
study behavior occurs in a quiet isolated work area but eventually 
takes place in the noisier general classroom area. 
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The second class consists of programming events that are antecedent 
to the child's behavior and these Include the Instructional materials 
and the modeling and prompting behaviors of the teacher. In the 
course of the academic year the child progresses from simple to com- 
plex materials and moves from a completely tutored context to one 
in which a teacher merely circulates around the classroom giving 
relatively Infrequent attention to each child. 

The third class of events comprises the management of events that 
are consequent to the child's behavior. These include error cor- 
rection procedures and reinforcers. Progressive change in the way 
the child's behavior interacts with consequent events Is of crucial 
importance. Beginning with whatever will motivate the child, gen- 
eralized token and :ocIal reinforcers are established. But the con- 
trived token reinforcers are ultimately removed and even social rein- 
forcers are partially replaced by reinforcers intrinsic to the aca- 
demic materials' themselves. 

The classroom teacher is, of course, the most Important component in 
the successful management of all of these events because the teacher 
is the person who arranges them. The teacher sets the* emot ional JUiiie_ 
of the classroom. She programs antecedent events by presenting in- 
structional materials, giving directions, and granting permissions, 
etc. Her mere physical presence often comes to control her pupils* 
study behavior. She programs consequent events by distributing her 
attention among the children and by correcting academic work. 

One fact that is often forgotten is that the children also manage the 
class by controlling the teacher's behavior. A good teacher uses this 
relationship to improve her own teaching skills. Each time a child 
fails to master a lesson, he is telling the teacher that she has 
failed to arrange the learning environment appropriately. If the 
teacher Is responsive to this, then it is literally true that the 
child teaches the teacher how to teach him. 



RESEARCH 

The research is both basic and applied. When designing applied re- 
search, -the experimenter i^-"Control4ed by the necessity of obtaining 
a useful end product/ He seeks to disco ver t he practical value of 
making specific changes in the environment. In basic research, on 
the other hand, the experimenter Is not necessarily looking' for some- 
thing useful (although this may result). The basic researcher seeks 
to discover the behavior changes that result from specific environ- 
mental manipulations. Although the difference is one of emphasis, 
different research strategies result (Skinner, in press). 



The basic aspects of our research deal with the identification of 
variables that are causally related to the development and mainten- 
ance of some desirable behavior. The research strategy begins with 
the definition of the behavior of interest. Baseline conditions for 
that behavior are then identified and stabilized. This is followed 
by the experimental manipulation, the recovery of baseline conditions 
and a replication qf^ the experimental treatment. The basic research 
IS thus of the within subjects variety. Variables that are related 
to the development and mai ntenance of attending to reading and arith- 
metic materials have been extensively investigated, A sample of this 
research dealing with bringing a child's behavior under the control 
of addition and subtraction signs is presented in the paper on arith- 
metic by Parsons, 

The applied aspects of the research to be reported here deal with 
academic program development and evaluation. After definition of 
the desired or terminal behaviors, the program (e.g., reading, writ- 
ing, spelling, composition, or arithmetic) is constructed in rela- 
tion to three things: 

(l^the desired behavior; 
(Zj^the child's current behavior; and 
(3^behavior principles derived from previous 
applied and basic research. 

Next, the program is given a try-out. If any part of i t is unsuc- 
cessful, it is redesigned (i,e,, a remedial unit is designed). An 
unsuccessful sequence is never simply repeated. Thus, program change 
derives from remedial units. The program change is, in turn, evalu- 
ated with other children. This means that the Laboratory's applied 
research is often of the between subjects variety, 

BEHAVIORAL ASSESSMENT 

We now turn to the problem of assessing the child's behavior in re- 
lation to his school environment. If assessment is to be useful, it 
should be an aid in planning, administering, and evaluating the indi- 
vidual chi Idis^urriculum, Standardized psychometric tests are not 
serviceable in this regard because they do not assess the child's en- 
vironment. In addi tion, eyaluat li^g an academic program on the basis 
of standardized tests alone does not produce adequate information un- 
less the program has been des ign e d^ to teach the specific behaviors 
measured by the standardized testl. Thus, we have been forced to 
utilize (and in some' cases, develop) addi tlonal assessment techniques 

The first of these techniques is the use of pre and posttests based 
on actual instructional materials. The pretests enable the teacher 
to place each child at his initial level of competence in each aca- 
demic program. The use of posttests, specific to smaller subsections 
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of each program, allows the teacher to evaluate the stability of re- 
cently acquired cognitive behavior and the effectiveness of the pro- 
grams. Examples of pre and posttest assessment are included in the 
papers on reading by Grimm and Berner afid on wr i t ing, -spel 1 i ng, and 
composition by Rayek and Nesselroad. 

The second assessment technique consists of information on all cor-, 
rect and incorrect academic responses, antecedent events (e.g., 
prompts), and the contingencies for responses (i.e., the social and 
token rei nforcers ) . Obtained primarily when a child is tutored, 
this detailed information can be used to evaluate the child's pro- 
gress, the behavior of the tutor, and the specific difficulties in 
the academic program. Reliability with an independent observer is, 
of course, maintained at the 30% level throughout the year. Examples 
of this type of assessinent data will be found in the papers on read- 
ing and ari thmetic. 

# 

The third assessment technique entails the^ recordi ng of the frequency 
of occurrence of stimulus and response events across s^uccessive time 
units. Frequency of occurrence data provides an objective assessment 
of the strength of behavior. Figure 1 represents data collected in a 
public classroom by an observer prior to the target child's enroll- 
ment in the Laboratory class. The child's on-task behaviors (e.g., 
oral reading or attending to instructional materials) and his off-task 
behaviors (e.g., wandering around the room or engaging in Inappropri- 
ate play^with another child) are coded in the top row. On-task is 
scored as and off-task is scored as F. Each box represents a ten- 
second interval and each ten seconds is scored for the occurrence of. 
on-task or off-task behavior. Antecedent and consequent teacher/chi 1 d 
interactions are coded in the second , row as Although the child was 
on-task 33% of the time, his teacher only interacted with him when he 
was off-task and was thus probably maintaining his off-task behavior^^^ 

Figure 2 shows the development of another child's on-task behavior in 
the Laboratory class. Consecutive observational sessions are plotted 
along the horizontal axis. The percentage of time the child was on- 
task in academic settings is plotted on- the vertical axis. As can be 
seen, the child increased her on-task behavior as the year progressed. 

These data simply describe the child's behavioral change. We are in- 
terested in the relationship between these changes and observable 

* changes in the environment. One way to explore this is to indicate 
the onset and offset of significant functional events. Thus, in Fig- 
ure 3, it can be seen that this child was off-task in the early part 

„ of her school career with and without token reinforcers. With pro- 
longed exposure to token reinforcement, she came on-task and then re- 
mained on-task when tokens were made non-contingent. 
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Bxanple of Data on One Child Taken in a Public School Classroom 
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Fig. k Example of frequency of occurrence data 
on one child in a public school classroom. 

It is also possible to obtain more detailed information on the deter- 
mining conditions. In Figure k we have plotted the amount of time 
that the teacher interacted with the child when the child was on-task. 
This interaction steadily decreases across the major portion of the 
school year with token reinforcement even though the child i;emains on- 
task, Teacher/chi Id interaction also i^ncreases when tokens "are no 
longer used to reinforce the child. 2 Thus, the child is well on her 
way to becoming academically independent and the assessment data indi- 
cate to the teacher how far she has progressed toward that goal . 



In eight rel iabi I i ty^^essions conducted across the year with 
this subject, relTaBTrTty with an independent observer averaged 99. 25^ 
for on-task behavior 93. 75^ for off-task behavior, and 98.50? for the 
occurrence of teacher/child interactions. 
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Fig. 3. The developmsnt of on-1ask behavior in relation to token 
reinforcement for one child. 
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Fig. 4. The development of on-task behavior in relation to token 
reinforcement and teacher/child interactions for one child. 



SUMMARY 

This paper has outlined the application of empirical behavior principles 
to the development of materials and procedures for the remedial teaching 
of young retarded and emotionally disturbed school children. The types 
of children studied, the classroom environment in which the research 
-takes^-p4Hace, and the nature of the research were described. The devel- 
opment of materials and procedures was viewed as an example cr applied 
research. 



Improvement of the remedial educational process cannot rely on simply 
measuring beh^ Moral change. Changes in the antecedent, consequent, and 
setting events that interact with behavioral change must be managed and 
assessed. In the three papers that follow, we will show hov.' an effective 
learning environment can be arranged for the teaching of reading, arith- 
metic, writing, spelling, and composition skills. Although the framev/ork 
for each paper deals with antecedent instructional materials, note that 
these are integrated with the management of setting events and behavioral 
consequences . 
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INDIVIDUALIZED READING PROGRAM'' 

linda n. berner 
Jeffrey a. grimm 

The teaching of reading involves bringing two classes of behavior under 
the cot rol of printed words. The first class of biehavior is the oral 
naming of wri tten words , phrases, and sentences which are already in 
the child's speaking vocabulary. The second is reading comprehension, 
which involves givjnii a correlated response for a printed word, such as 
finding a picture or^ object , giving a verbal definition, or demonstrat- 
ing an action. 

This paper will describe the program used to teach oral reading and com 
prehension behaviors, discuss the types of» moni tori ng data collected to 
evaluate the effectiveness of the program and assess the progress of 
each child, and present a study In which a 'mother learned to use the 
reading program at home. 

DESCRIPTION OF THE PROGRAM 

The tasks in the program are grouped in Table 1 according to the two 
classes of behavior to be taught. 

TABLE 1 : COhlPONENTS OF THE INDIVIDUALIZED READING PROGRAM 



Oral Readina: 1. 



2. 



3. 

Comprehension : '. 1 . 

2. 

3. 

k. 

^Reading tasks given for each new word; these four 
tasks aonstitute a unit of the program. 



We would like to thank Dr. Sidney W. Bijou for his suggestions 
and encouragement in the writing of this paper. 



SIGHT 

A. Discrimipation 

B. Oral Reading/Discrimination 

SELF-PROMPTING 

A. Word Forms 

B. Blending 

ORAL READING PHRASES* 

PICTURE IDEXTiFICATION'^ 
READING COMPREHENSION* . 

STORIES ■ 

DIRE-CT40N TABLE 
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Oral Reading 



The flr^t task In the sight section of oral reading; is discrimination. 
The ability to discriminate one word from another should be precurrent 
to the oral reading of words. Data on this relationship are presented 
ir Table 2. , 

T ABLE li RELATIONSHIP BETWEEN PERFORMANCES ON THE ATTENDING 
PRQGRA14 AND THE INDIVIDUALIZED READING PROGRAM 

ATTENDING PROGRAM 
DISCRIMINATION LEVEL S, READING-UNIT I 



CHILD 


ZERO-DELAY MATCHING ACCURACY 


ACCURACY 


<^K. D. 


* 20% . 


55? ► 


-^B. B. 


60% 


71?^ 


•^H. G. 


^P% 


64? ► 


-^W. J. . 


- . Q9% 


8I?^ 


•^S. M. 


60%, 


81?^ 


"^K. S. 


20% 


- 81? ► 


•^C. B. 


40? 


--54? 


"^N. 'b. 


100? 


98? ^ 


•^M:. L. M. 


100? 


95? ► 


■^M. K. 


100? 


98? ► 



The ch LLdrenjvhojperformed below 901 on' the discrimination program 
also performed below 90^ on the first-part of the accual reading pro- 
gram. Those children who did reach the 90^ criterion on discrimina- 
tion v/ere successful nn the beginning of the reading program. 

The children In the first group, those who needed training In dis- 
criminating words, were given materials of the type shown In Figure K 
Initially, a simple match-to-sample response, in which the sample and 
the choices are available simultaneously, was required. This was grad-^ 
ually changed to a zero-delay matching task in which the sample and the 
choices were never available at the same time. 

This discrimination task uses the same printed words which later serve 
as the, cues, or discriminative stimuli , far the oral reading response. 
Reading behaviors, however, are ultimately maintained by response con- 
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Fig. I. Sample frames from the Dis- 
criminalion Program. 



tingencles such as parental approval, as well as the Intrinsic rein- 
forcers available to reading, such as the excitement of a mystery 
story. These contingencies are utilized as quickly as possible by 
rapidly providing the child with a small s Ight- reading vocabulary. 
The sight reading approach allows the child to acquire quickly a 
reading vocabulary su^^^Ient to demonstrate to himself and others 
that he is able to re^^ 

*■ * . 

Development of sight oral reading skills begins in the Oral Reading/ 
Discrimmation task* This sequence teaches the child the verba^^ 
equivalent of a printed word while discriminations are used for the . 
introductory frames of th^^ new word as well as for error correction. 



On the sampje page, \n Figure 2, the child reads the words in the 
left column. If a new word is being Introduced, as in the last 
three frames, or if any error is made in oral reading, the child 
is presented with a zero-dealy matching task using the words on the 
right. 



OR/D 1-4 



city 


omty c i ty cohg 


two 


two 

+ 


two s ' 


gmn^^uj two nsqzym 
+ 


two 


gmyzs two erumj 

i 



Fig. 2. Sa.iiple frames from Oral Read- 
-^g/Oi scrimi nation. 
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The next component of or^l reading is Oral Reading Phrases. A sample 
of the materials is shown in Figure 3. Here the child Is presented 
with longer combinations of words.. A phrase read in a word-by-word 
sty e IS not accepted while a phrase read In a smooth, conversational 

!ln J%^^^ '! ',, " capitalization and punctuation, as 

well as their controlling functions, are also introduced. 

For a chlfd who has not previously experienced success in reading, 
using-his sight vocabulary skills to read meaningful phrases is a 
reintorcing experience. 



ORP 11-9. 



One, two, three go. 



Go. up the streets and out to work. 



Fig. 3. Sample frames from Oral 
Read I ng ^Phrases . 



1^ 



Self 'Prompting 

I 

\^ile the sight approach al lows t* child to quickly acquire a mini- 
mal vocabulary, self-prompting s!..lls are necessary for a child to 
become an independent, efficient reader. The subprograms in this 
section (plural --^ endi ng; verb endings -^d, and -iruj ; and com- 
pound words) all utilize the child's present vocabulary to teach 
skills which can then be applied to new words* The child is also 
required to respond to the letter-name letter-sound relationship of 
ini tial c onsonants* Given a written letter, he must respond with 
that letter-sound and, conversely, hearing the sound of a letter in 
a word, he must respond with the letter-name* When a child has mas- 
tered several consonants, he is required to blend these with root 
words learned in the sight program* This skill li the sel f -prompt in^ 
device which enables the child to sound out a specific type of un- 
known word* 



Comprehension 

All of the tasks discussed thus far concentrate on the development, 
of oral reading skills. Reading, however, requires more than orally 
naming words* Comprehension is also necessary* The first task in 
this area is Picture Identification* This is the most primitive of 
the comprehension components, requiring only that the child respond 
yes or to a question about a pictoriat representet-i o n-of a word 
TeTg*, 'Ms this a picture of girls?'*)* 

-The ;!ii xl Id&kT Reading Comprehension, is shown in Figure This 
task also uses a pictorial referent* However, the child is required 
to orally read the word or phrase as well as to determine whether 
the picture is or is not a referent for the word or phrase* He in- 
dicates his answer by circW-rrg- the yes (smiling) faca or no (frowning) 
faa&r- 

The third component of comprehension is Stories* While stories are 
important as a comprehension task, they also serve as reinforcers for 
reading behavior and as a review of known words, both in the origin- 
ally taught form and in alternate forms (e*g*, plural nouns or past 
tense verbs)* The comprehension of story content is* evaluated by the 
child's response to questions which are asked throughout each story. 
They are of two types: recall of specific story content or para- 
phrasing (e*g*, "How many boys are in the store?"), and construction 
of answers requiring interpretation of the content (e*g*, "Why do you 
think the boys went to the store?")* 

The final comprehension task Is the Direction Table. Here the child 
is required to make an overt, physical response to written sentences* 
The child is asked to read aloud a direction in'a booklet, and then 
manipulate or arrange materials in accordance with the di rection g iven 
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many 



one 
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one city 



Fig. 4. Sample frames from Reading Comprehension. 

For example, a written direction might be, **Fut the car on the 
street.*' The child would be required to- read this direction, take 
one of the toy cars, and place it on a model street. The manipula- 
tion of the -materials is the behavior which demonstrates that th'^ 
child, has understood what he read. This, therefore, is the behav- 
ior which^fs^re info reed. 
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Sequence of Teaching the Program 

The component parts of the reading program are presented to the 
child in the following order. After the completion of the dis- 
crimination program, the child begins acquisition of oral reading 
skills through the sight program. Each new word ib taught and 
maintained through the use of Oral Reading Discrimination and. Oral 
Reading Phrases. The elementary comprehension tasks, Picture Iden- 
tification and Reading Comprehension, are also used with each new 
word. These four components make up a core unit of the sight pro- 
gram. Self-prompting skills, which are used to expand the child's 
vocabulary, are introSliced after the child has mastered a minimal 
number of sight words and when his performance on the sight pro- 
gram has stabilized. Stories and Direction Table are given ac- 
cording to the extent of the child's reading vocabulary and are 
programmed to become increasingly more complex. 



MONITORING PROCEDURES 

Each child's progress through this program is monitored daily in 
order to assess the effectiveness of the program and to determine 
the child^s next assignment. The child continues to move through 
the program as long a s he maintains the 90^ mastery criterion. If 
his accuracy fa 1 1 s^be^t ow 901 , a remedial unit is prepared^and ad- 
ministered* 

The following graphs are examples of this type of data. Figure 5 
shows one child's accuracy on Oral Reading/Discrimination. Sixty 
core units of the program are represented. On both graphs in 
Figure 5 successive upits of the reading program are plotted on 
the horizontal axis and percentages of correct responses are plotted 
on the vertical axis. The dashed line represents the 901 mastery 
criterion. For each point below this line, a remedial unit is ad- 
ministered untij 901 criterion is reached on the original unit. 
These remedial points do not appear on the graph. The Roman numer- 
als refer to sets of the program, each set including ten units. The 
upper graph shows accuracy for oral reading only. Each of the data 
points represents initial accuracy for a new vocabulary word com- 
bined with accuracy for a limited number of review words. Oral 
reading accuracy for this child has remained high throughout the 
school year, which indicates the efficiency of the program. The 
lower graph in Figure 5 shows the accuracy for the discrimination 
part of the task* It should be remembered that discrimination is 
basically an error correction procedure for oral reading. It can 
be seen that th»s child can accurately discriminate" thentarget 
words and that the behavior is maintained throughout the year. 
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Fig. Oral Readi ng/Diserimination. 

Figure 6 shows another child's performance on Oral Reading Phrases. 
These graphs. cover the first 3^ units of the program. The top graph 
is oral reading accuracy/ Again, no remedial units or corrections 
are shown, though they were administered wherever accuracy dropped 
below 90^ criterion. This child's accuracy has remained high and 
stable throughout the program, with only t>ne point falling below 30%. 
The lower graph .shows oraj, reading rate. Here, the vertical axis 
represents the number of correct responses per minute. Decisions 

-atout reinforcement^ schedules are made on the basis of these data. 
When an increase in rate is apparent, reinforcement schedules are 
changed so that the child must complet-e-morex^ork -to receive the same 

■ about of token and social reinforcement. ' Wi th this child, corrections 
in the reinforcement schedule were made frequently in Units III and IV 
bis^r.e oral reading rate was increasing. 
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Fig. 6. Oral Reading Phrases. 



The data in Figure 7 show a. thi rd'^ chi Id's performance on the Reading 
Comprehension task. The graphs begin after the child has completed 
40 units of the program and continue through 100. units of the program. 
Both graphs show accuracy, the upper one for ora^t .reading, the lower 
one for comprehension. These two measures are separated since it. Is 
.Important to know how the child is progressing in both areas. For 
example, while this child does very well tn oral reading, she has 
difficulty with comprehension. For most errors in comprehension, re- 
mediation is performed immediately and the frame Is repeated. Only 
the child's first response, however,- is recorded. More formal reme- 
dial units are given only when the accuracy remains "consistently low 
for the same word or phrase. The pol ncs labeled Q on the graphs rep- 
resent core units that were not given ta the chi^ld because she could 
read and define the word taught in those units on the pretest. The 
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Fig, 7, Read i ng Comprehension, 

frequency of these points increases as the child progresses through 
the program because she is simultaneously acquiring self-prompting 
skills, ReliabiUty on the collection of this monitoring data is 
vtaken periodically by independent observers. It is established and 
maintained at S0% throughout the year. 



Remedial Units 

The data presented thus far are used as a basis for making decisions 
about the child's academic progress and about reinforcement schedul- 
ing, A more detailed example of the monitoring and remediation pro- 
cess is shown in Figure 8, 
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Fig, 8, Combined Oral Reading Phrases and Oral Reading/ 
Discrimination accuracy before and after a remedial unit 
and the percent of correct responses' rei nforced with tokens 
for all words (top graph) • The combined Oral Reading 
Phrases and Oral Reading Discrimination accuracy before and 
after a remedial unit for the words "a** and "day" (middle 
and bottom graphs respectively). * . 



Units of the reading program (numbered on the lower graph) are repre- 
sented on the horizontal axes. The vertical axes show percentages. 
The solid curves indicajte percent of correct responses, arid the dashed 
curve indicates frequency of token reinforcement. The 4 portion of 
the top graph shows that the child^s performance on oral reading and 
comprehension tasks was generally accurate and stable after k] units 
of the program. The dashed 'curve shows that token reinforcement was 



about 25% * Unit 42 Introduced the word day. The middle graph shows 
accuracy for this word only. ' It can be seen in the F portion of the 
top and middle graphs that overall accuracy remained stable and accu- 
racy for the word day decreased across Units 42 through kk. Assuming 
that 'the low rate of token reinforcement (seen in the broken line) 
might have been reflated to the* decrease in accuracy, the frequency of 
token reinforcement was i ncreased wi th the introduction of Unit 45 
(£ portion of the graphs). Unit 45 introduced the new word a, whose 
accuracy is shown in the lower graph. Even with increased reinforce- 
ment, the accuracy for daz^^de creased and the word a was not acquired. 
Repetition of Unit 45 did not result in mastery of either word. How- 
ever, during this repetition, the child usually responded with the 
verbal day to the v/ritten word a and vice versa. Therefore, a reme- 
dial urij_t_was constructed that emphasized discrimination between the 
written form of a and day and utilized a much-condensed version of 
the normal transition from the reading discrimination tas4<-to the or- 
al reading phrases task. Following the successful admiru^sjuiation of ' 
this unit, the child went on in the reading program. Portion D_ of all 
graphs shows that the child's accuracy rose immediately to 1001 for 
the words day and a as well as for the new words in Uni!:s 46 and 47. 



Fosttest Evaluation 

It has been 'mentioned that a systematic review of previously acquired 
words is used to maintain oral reading behavior. The usefulness of 
this process can be seen in the post test data -shown in Table 3 for all 



TABLE 3 : HEADING POSTTEST ERRORS AS A FUNCTION 
OF NUmER OF RFVIEW-SESSIONS 



NO. OF 

UNIT REVIEW PERCENT ERRORS^ 

NUMBER SESSIONS ON POS TTESTS — ^ 

1 — 1 if 

1 3 1.63 

2 3 1.63 

3 3 2.44 

4 3 2.44 

5 3 .81 

6 3 .8! 

7 - 3 1.63 

8 2 4.88 
9" > I 6V50 

10 ] 0 12.20 



]68 • ' 

children on the reading prpgram. these data are based on 123 separ- 
-ate posttests. A postftestJ Is, given after every set of ten units of 
the prdgr'am and co^i^^x^^^jh^^ten words^-'rrcl uded In \that set. The word 
taught -in a given dnft appears frequently In all of the component 
tasks .of the next three units. .Subsequently It, is systematically re- 
viewed in the Reading ^Phrase^ and Reading Comprehension tasks only. 
Therefore, a^ the time of the ^posttest , the-wotids^-taught i n Units 8, 
9, and 10 have had the least amolmt of review, *The table shows that 
« for those words which have had at least three reviews, the average 
percent _of errors is 1.63.' When review* sessions drop to zero, the 
percent of errors increases to 12.20. Therefore, It appears that 
the review is functional -as a ^alnt^pance devic'e. The data also' 
show that-posttest errors in genei^^are low in frequency,* ranging 
from less than one percent to about tv/elve percent as review is de- 
creased. This is an indication of the efficiency o^f tiic program. - 



— ^ " PARENT TEACHING - 

^The program's use is notjlmited to the classroom and Its staff. Fig- 
ure J9 show§ a^ hyperactive child*s progress pn the program'. The open 
circles represent the cumulative number of> correct responses completed 
and the ciosed circles represent the number of Incorrect responses, 
baqh^ data^point. represents -reading output summarized over three read- 
ing days. Days In which no r udlng'ocdurred (i.e., weekends fnd hoi* 
idays)" are not represented. Durmg the period .Marked A_ the chi^ld read 
excJusJvely during a 25"^iilnute tutored* reading period at school. .Th6~ 
. rates shown- are typrcal. of the other children on* the program. u 

At point S, the child's mother,. who had a past-4^J&tory oi^ i nef feet i*/e 
interact ion -wi th her son, began to tutor him at school. The-cfiild's 
performance was unaffected; both correct and Incorrect responses re- 
mained stable. ^ ' / • . 

During £, .the child worked with his other at home as well as with his 
regular reading tutor at sehor^-. • The rate of /correct responses doubled 
During the 30 days of £, the child maHe ^lOOO correct responses. - During 
the 66 days of ^, the chlld^made kS^-O correct responses. Rate- of in- 
correct responses rerained relatively constant. 

- AA^ represents a second pier iod during wiiich the child Vead only at , 
schdoj-wi'th his tutor. His performance was comparable to that in con- 
dition i4. In his mother again tutorerf'him at home and performance 
increased asMt had in period £. These data suggest that a mother can 
be trained to use. this complex reading program at home with results 
that significantly augment the teacher's efforts in the classroom. 
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BLOCKS OF THREE DAYS 



I 



Fig, 9, Cumulative record of the progress of 
A, D, in completing the Individualized Reading 
Program*, - . _ j ^ 



SUMMARY 



Research on reading has been concerned with both oral read! ng and 
comprehension behaviors. The resulting .Individualized Reading Pro- 
gram utilizes a combined sight and phonetic ap proach jn teaching oral 
reading. Sight readTng tasks enable the ybiihg handicappedTchI Id to 
experience^success jlL^'^^ding and, hence, access to terminal rein- 
f on c er s as quickly as possible. However, It is realized that the _ ~ 
child must eventual ly acquire sel f-prompting skills' if he is to be- 
come, an efficient, Indepiendent reader. Reading comprehension Is 
taught in four tyoes of t as^k^ . The most primitive of. these requires 
t He ch ild) to TBetrtify a picture referent for a word and the most complex 
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requires him to follow written directions without assistance ft^m 
the teacher.^ . ' 

Evaluation of the program*s effectiveness and each child^s progress 
J-S-^cpmpU sbed- by m6nit:?>Ting performance on each Teading taslcr^Data 
for this purpose are oral reading and comprehension accuracies, oral 
reading rates and scores on pre/posttests . This Information serves 
as a basis for curriculum planning for each child ('^.g., remedial 
units, and reinforcement schedules). Th* program has also been suc- 
cessfully used by parents outs/ide the classroom situation. 
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Application of behavior principles 

to the teaching of 

writing: SPELLING & COMPOSITION ^ 



ely rayek 
elixabeth nesselrqad 

This research is concerned wi th the development of instructional ma- 
terials and' procedures for teaching writing, spelling, anci composi- 
tion to young handicapped children. Although each of the three pro- 
grams has distinctive objectives ^nd incorporate different procedures 
'^they are functional ly interdependent* The' program progression is^de- 
signed so that wri-ting is maintained by^spelHng an3 spelling^ is main 
tained by composition. 

This paper describes' the research oh the writing, spelling, and compo 
sijtion programs in terms of the analysis of the task to be taught and 
the procedures explored in arranging condi tions JLQ_expedi.te their 
learning. Samples of data will also be presented. 



WRITING 

The writing program has two terminal behavi,oral objectives: 

(l^^rite_f rom dictation all o f. t he upper and* 
lower casu letters of the manuscript alpha- 
— bet and all numbers from 0 to 9; and 

(2?^ rite and blend from dictation all of the 

jpper and lower case letters of the cursivef ~" ^ 
- alphabet. ^ - 

tn constructing a. program to teach writing to young handicapped chil- 
dren, several points are considered. First, writing Is taught by 
shaping procedures, ft is the gradual shaping of a motor skill to 
the point where the response approximates" a specified model. = Second, 
letters are made up of stroke elements. A task analysis suggests 
'that the elements requiring the leasr complex motor responses are the 
horizontal and vertical lines. Slanted lines and curved lines are 



^ ' We wish to express our appreciation to Or. Sidney W* Bijou for 
his guidance In this research and his editorlril assistance with the 
"manuscript* ° ^ 
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more complex. For maximum progran. efficiency, letters containing com- 
mon elements are grouped into families and taught together. For-=^in- 
stance, all Jetters us 'ng straight lines are taught before letters 
containing slanted lin.»s. According to the , task analysis, letters 
Within a given family are ordered according to their difficulty and 
assigned in that order. Figure 1 S'hows the stroke elements and the 
letters and numbers which include them. Third, copying. a letter from 
a visual model precedes writing a letter from dictation. This proce- 
dure is "used to assure that JtKe xKi^lJAi^eqtij'p^^ to make the appro- 
priate strokes prior to writing frSiOictation. Fourth, writing is 
functional when it is used i D^practlca^l* ways, such as writing one's 
name, words, or stories. Once- these meaningful uses of writing are' 
possible for the chi Id, .the social interactions which ensue take over 
to maintain the behavior. 
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Fig. I. Elements and letter families. ' 
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Mamsaript Writing 

There are two prerequisites to the terminal manuscri'pt oBjet;TTves : 

pencil holding; and 

(2) discrimination of wel 1 -formed and poorly- 
^"^=Tormed letters. . / 

Children who at the beginning of^the school year do not hold tfi^ pen- 
cil correctly are given instruction by means of a modified modeling 
procedure. When this procedure is ineffective,* a colored dot \i 
placed on 'the pencil anrf on the corresponding part of the child's 
hand at every point v^here the child's hand should come in contact 
with the pencil. The child then matches the colored dots to achieve 
the correct positron for holding the penciK^ 

The ability to respond differentially to poorly-formed and well-formed 
manuscrt.pt letters is a second important prerequisi te which^enables 
the child not only to correct anu to reinforce his own written re- 
sponses but to work indepenJencly . A subprogra'm was designed to teach 
the child^ thi.s skill by reqiiring him to discriminate between^ poor ly- 
formed and well-formed letters. In the initial frames the child" is 
required to match well-formed lettejjs. Example frames are shown in 
Figure 2. , 

The core writing program requires four different classes of responses: 

^ (1) copy the letter from a visual model; 

(2) write the letter from dictation; 

(3) recognize the letter; and ^ 

(4) name the letter. 

Letter recognition is a prerequisite for letter naming. 

Procedurally, the program for c6py4ng letters from visual models util- 
izes (1) the giving and fadi ng, of proi.»ptS7"arrd (2) the reinforcement 
of progressive approximations to the desired end-product* Prompts 
used are of two types: visual and verbal. Visual prompts consist of 
line and dot cues which the child is required^to trac&. Initially, 
the-chiid must trace a model of the letter.. Then, he is required to ^ 
trace models of the letter-wh1^H are in dot* format^ (e.g. ,T for T) . 
Fewer dots are provided for '.subsequent responses unt:!, terminally, 
there are no dot$ provided. Verbal prompts are instructions whfch.pre- 



More detailed information. is available on instruction in pencil 
holding in the Filial Report to USOE, Augjst 1971, ent!+ .d "Application 
of Behavioral Principles" to the Remedial Instruction i Retarded and 
'Emotionally Disturbed Young Children." 
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Fig. 2* Sample of initial frames used in the pro- 
gram tpi teach the discrimination of well-formed 
letters* * = ^ 

cede a response and might be, ''Make a straight slanted line" or »*Make 
the circle smooth." 

After an incorrect copying response, the teacher makes changes on the 
child's response to make. It consistent with the model (e.g., straight 
ening crooked lines^or drawing the letter between the ines) / ^^rmw 
letter is begonr^some times with dot prompts^ sometimes without depend 
ihg on the chi.ld*s previous responses for that letter. When a child 
has demonstrated that he can make a wellrformed letter but he is not 
consistent in writing the correct response, an appropriate verbal 
prompt is given prior to the next response. However, since verbal er 
ror correction procedures ha\^ reinforced incorrect responding for 
some children, verbal interaction or verbal prpmpts are kept to a min 
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imum. When they are used, it is always in the context of the next re- 
sponse and not of the one. oh which an error was made. After^+»e chil'd 
copies the letter at least three times in recognizable form, visual 
models are eliminated and he is required to write that letter from die 
tat f on. 

Procedurally, the dictation task consists of the te^er covering or 
removing all visual models and saying to the- child, for example, '*Make 
an ^J* When the child makes an error imakes a different letter than 
the one he is instructed *to make) the teacher provides a model and 
instructs- the child to copy It. If the child writes the correct let- 
^ ter from dictation' but the form is incorrect," the same error -correct- 
ion procedure is used.as on the copying responses. After the child 
makes a recognizable form of the letter on three consecutive attempts, 
that letter ts mixed with other previously mastered letters. and he is 
required to write them^from dictation.' This is Hone tpassure that - 
the child's response is under the contfaHof- the name of the letter 
and is not a result of repetition. 

Scoring of J Let^ters is according to two sets of criteria. F*rst, all 
letters written (both from-a model-and from dictation) are scored 
according to letter form. Letter form is evaluated according to 
specific criteria. Tffc letter must be within and just touching the 
guidelines; horizontal, vertical and slanted lines'must be straight; ^ 
curved lines must be smooth. Samples of ^*,eptable forms are given 
^ ifl the upper ^part. of Figure 3. Criterion for mastery of letter form 
^iVtwo consecutive sessions with SQ% accuracy. Scoring reliability 
is obtained by an independent- observer and- i s ^mai ntained about 905^ 
throuoHout the progVam. Figure k illustrates the number of responses 
to criterion for- a child on writfing the sequence of letters,. For the 
—first letteri taught, the lower case £, the chi|d required more than 
^ 300 responses^ to reach criterion* - For the^number four, which is made 
up of three strokes, ,the child required less^Jthan '0 responses to 
reach criterion. It is interesting to note that the number of re- 
sponses to criterion fo- letters With sManted^strokes.^remained low in 
comparison with the number of /responses to criterion for the initial* 
letters of the first /ami l,y^ 

^ The second set of scoring criteria is for dictation .responses whi ch 
are scored as either correct or incorrect in terms of whetTier a letter 
is' recognizable as the assigned one* An exdiiiplelof acceptable (or 
recognizable) le,tters for the dictation response 1s given. in the lower 
part of Figure 3. Although accuracy for individual letters i,s com- 
puted, all letters written from dictation in a single perlpd^are com- 
bined to derive an overall accuracy score* Typically, children in our 
program maintain an accuracy nearly always above 90% even though new 
letters are being 'ntroduced daily. 
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Fig. 3- Examples of both .acceptable and unaccepfabi 
letters for the dictation and copying responses. 



Letter naming Is taught simultaneously with copying a letter for two 
reasons.' First, since mastery of letter form requires many copying 
responses, there U good opportunity for the child to recognize and 
name the letter, second, writing from dictation, taught after the 
child's initial letter' naming reslppfses, appears to be^ .facilitated 
by the letter naming skill. _ ' . / . 

At the beginning the child Is required to recognize the letter (e.g., 
*Ms this an ^?** or "Shew me an 4.**). Later he is required to name 
the letter (e.g.,jmat is the name of this letter?**)- Within each 
class period, the child Is required to name or recognize more than 
one letter. As with the dictation task, chl Idren jnalntain high ac- 
curacy (above 90%) for letter naming. When the child makes .an error 
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Fig. 4, ^Sample data of a. child's performance in 
writing letters. 



on naming, recognition, or dictation^ tasks, „hi^.js corrected, prompted, 
and asked to repeat the response. 

Many opportunities to respond ;to copying, dictation, and naming tasks 
are provided in each writing pier lod. For instance, the teacher asks 
the child to copy an ^ She reinforces hisH'esponse and then says, 
^Ms this a big Al^*^ (the recpgnitlon task). Another copying response 
may be followed by ^an opportunity to name^^e^-letter. After the chfld 
makes a recognizable form of the fetter, -the teacher might eliminate 
all visual prompts and ask him to write the letter from dit:tacion. 



Cursive Writing 

A cursive writing program is available for children who complete the 
manuscript program. Only those children whose responses in the manu- 
script program, are both accurate and rapid are assigned the new pro- 
gram. In addition, only children for whom the new skill would be 
mai'ntained upon their return co publi.c schools (children going into 
second or third grades) are introduced to the cursive program/ 

— • , 

As well as being able to name, copy', , and write from dictation the 
fetters of the alphabet, the child is tau^hlLto write a cursive let- 
ter from a' manuscript model. Procedural ly, the child'is presented - 
with both a cursive and manuscript model. (Figure 5-A) He is in- 





4i 



1 



Fig/ 5. £ and 5. Sample frames of the- program used t<|i teach 
the equivalence of Inanuscript .and cursive letrers.f j'l 

(j Sample frame of the remedial pr^rli^^W^to ^ 
teacL the'^equi valence of manuscript and cursiMe letters. 
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structed to name the letter and make several copying responses. 
When the child can make a recognizable form_af the cursive letter, 
he is presented with just the manuscript letter model and in- 
structed to, "Write this letter in cursive style/' (Figure 5-B) 
On letters for which this procedure is ineffective, the child is 
given remedial frames like those shown in Figure 5~C. He is in- 
structed to read the letter on the left, cover it, and circle and 
name the letter with the same, name. * ' 

The cursive program concludes with a procedure for letter bJendjng. 
The program proceeds from practice in /copying groups of two letters 
to 'copying words. .Terminally, the child is, able to write such let- 
ter combinations f nom -djctation* 

' SPELLING ' " ^ 

Spelling is analyzed as the oral or written production of the let- 
ters of words in a given sequence under. the control of spoken stim-. 
uii. The skills acquired in the^writing program, those of naming 
and writing the letters of the alphabet, are prerequisites for- the 
spelling. The terminal objective of the Sfjelling program is that 
the child spell - in both oral and wr i ttenfform - all of the words 
in his reading repertoire. * 

The sequence in spelling is shown in Table 1. First the child reads 
the word and the^letters of the word from a study card. Then in a 
delayed matching sequence, he looks at the word, turns the card over 
so that the model is hidden, and immediately writes the word. After 
he has written the word, he exposes the model and T:hecks 1i is spell ing. 
In a single period, these first three steps in the sequence are com- ^ 
pleted for all words assigned (usuajly five words in a 20-minute per- 
iod). Then the- teacher removes all, printed material and requj_res the 
child, to spell the word orally. The^acher says, for example, "Spell 
oity .V After the child orally spells all assigned words, he is re- 
quired to write the words from a spoken model (e.^g. , "Wr i te city .") . 
After the child writes each word, the teacher checks the child^s work. 

The. child goes through different error correction procedures depend* 
ing on the'' errors he makes,_^ The column on the . right side of Table 1 
shows the error correction procedures. If the child incorrectly 
reads the word, , the teacher cprrects'him and,prompTi5 him to read it 
correctly. If the child incorrectly reads any letter of the word, 
the teacher stops him immediately, corrects him, and requires him to 
give the spelling response chain from the beginning. The child cor- 
rects his own spelling in step 3* If he is incorrect, he has to re- 
peat the delayed matching sequence, writing the word again in the ab- 
sence of a pri nted model . If the child makes an error^while spelling 
the word orally, the teacher stbps him and gTves^ the, correct sequence. 
Then the ch{1d|is required to spell the word from the beginning once 



180 



SPELLING PROGRAM 



NO ERROR SEQUENCt 
****** 

The chl Id*: 

(Q 'Reads the word from a 
study card. 



city 



ERROR CORRECTION PROCEDURE 
************ 



(T^ Teacher corrects .the chi Id 
and prompts him to repeat 



.(5) Reads the letters of 
the wordV-f Fom a study 
card* 




Teacher stops him^ corrects 
him, and requires- him- to 
start again. 



Turns card over and 
writes the word. 




@ Child looks at ^ the card,^ 
s chpcks hi s spel I } ng, and, 
^'""'"aX-'i ncorrect, =wri tes i t 
agai n. ~ 



^ Spel Is word oral ly 
from spoken model.- 



V/rites word from a 
spoken model . 



{4j Teacher stops him, cor- 
''spell city" . rects him,' and he starts 
again 



^Teacher writes the word 
'*Qity'' and asks the child to copy 

It. 

********.**************** *^"* ***** 



TABLE J : Left Column^ Sequefice for acqutring spelling. , 
Right Column: Error correction procedures at 

each step of the sequence for ac-. 
qui ring spel I ing. 



more. In the final step, if the child. writes th€^ word Incorrectly from 
a spoken model-, the teacher provides him with a handwritten model of 
the word and^requlres him to copy It. Jhls lower level task assures 
that the child Is re-exposed and reacts to the correct response after 
he has made an error|. ' The behavlors\ requi red In steps 4 and 5 are the 
' termi nal object Ives ^of t4ie program, ]The criteria for mastery-of any 
word Is that the child spell it correctly In both oral an3 written form 
from a spoken stfmulusffn two consecutive periods. The child's progress 
(and as a consequence the effectiveness of the program procedures) Is 
monitored by recording the number of words mastered dally. 
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Figure 6 shows the cumulative records of two children in this program* 
This figure shows that as the children move through the program their, 
progress becomes rapid and stable* It.wlll be noted that the child's 
performance represented^ in the top graph shows that.he mastered about 
two words per day. The lower graph shows the progress of a child who 
mastered about one word per day. . Each child had two 20-minute periods 
of spel 1 ing .each day. 
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Fig., 6. Sample performance of two children on the spelling 
program. (Horizontal axes represent days in the program. 
Vertical axes represent number of wjords mastered.) 



, COMPOSITION 

Composition Is viewed here as an extension of writing and spelling 
where the production of phrases and sencences Is under the control 
of pictures, questions, dl rections' or the child's own verbal, behavior. 



Composition, in Its terminal form, is a constructgd or creative behav- 
ior. Specifically, it must fulfiP two requirements. First, it must 
conform to the conventional rules of grammar. Second, the behavio* 
must be functional: it must evoke a characteristic response from ti 
reader. 

The- terminal behavioral objective for the composition program is that 
the child produces meaningful phrases and sentences in response to 
gehera^l directions. There are three prerequisites t(^H'S— program. 
First, the child must demonstrate minimal skill in seritencj^^onstruc- 
tion, ^Ihis is an extension of the spelling and language programs aid 
is taught simultaneously with composition. Second, he must have the 
necessary reading and spelling skills to embark upon the composition 
program. The number of words a child can read and spell determines 
the complexity of questions and answers used in this program for that 
child. Third,. the child must be proficient in writing groups of words 
from dictation. This skiJl is an extension of the requirement of the 
spelling program and is mastered by the child prior to his beginning 
the composition program. 

In the initial phase of the composition program the child is required 
to respond to both a picture and a question. In the presence of the 
teacher, the child reads the question, looks at the picture, and re- 
sponds' orally to the question. He is then instructed to write the 
answer to the question. It need not be a complete sentence. The main 
concc is^^that the child's response "make sense*,'' After the child 
becomes proficient in this skill, the same material is presented again 
with the requirement that the child's response be in an acceptable sen- 
tence form. 

In the third *step, material of a similar type is presented but the 
teacher is no longer present to respond to the child's reading of or 
oral answer to the question. The only behavior to which the teacher 
responds is the written product. Although errors in spelling and 
grammar are corrected, ^ the child is encouraged to use new words even 
if he misspells them. For example, a response containing spelling 
errors would be reinforced and then spelling errors would be corrected, 
A grammatically correct answer with no spelling errors which Is not 
an appropriate answer to the question would not be reinforced. 

In the fourth phase of the program, the pictorial stimulus is elim-' 
inated. The child is asked a speci'fic question such as, "How do you 
go to school?" The response Is judged in the same manner as in the 
previous uni t. 

In the fifth phase of the program, the specific question is replaced 
by general directions. Initi<illy, pictures are again presented and 
are then faded. An example of the initial general directions might 
be, "Write one sentence about the picture," An example of general 
directions in the last phase of the program might be, "Write one sen- 
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tence about your family." More advanced units require the child to 
write an increasinq number of sentences about the picture. 

Notice that this program begins with multiple cues for the child's 
response which are gradually reduced. In the initial phase of the 
program, there are three observable cues: the picture, the question, 
•and the child's oral response to the question. In the last phase of 
^the program, there is one cue: the directions. 

On the cdmpositlon pretest, one child In our program ,was unable to 
give even a verbal response to the question-picture frames. After 
completing the program just described, the chl Id responded consist- 
ently with stories of four or more sentences on assigned topics. 



SUMMARY 

This paper describes the. research on the writing^ spelling and compo- 
sition programs terms of the analysis of the task to be taught and 
the procedures explored In arranging conditions to expedite their 
learnlngH 

The writing program which consists of shaping procedures has two ter- 
minal objectives: 

(1) write from dictation all of the upper and 
lower case letters of the manuscript alpha- 
bet and all numbers from 0 to 9; and 

(2) write and blend from dictation all of the 
upper and lower case letters of the cur- 
sive alphabet. 

The core writing program requires four different classes of responses 

' (1) copy the letter >(rom a visual model; 

(2) write the letter rr^p4i£^3t*o" 5< 

(3) recognize the letter; and 
W name the letter. 

The cursive program requires, in addition, writing cursive letters 
from their manuscript models. The cursive program conci udes wi th a 
procedure for letter blending; Spelling is analyzed as the oral or 
written production of the letters of words in a given sequence under 
the control of spoken stimuli. The terminal behavioral objective of 
the spelling program is the child spelling in oral and vjritten form 
all of the words in his reading repertoire. The core of the spelling 
program requires the child to (I) read a word, (2) read the letters 
of the word, (3) write the word without the written model present in 
a delayed matching sequence, {k) spell the word orally, and (5) write 
the word from a spoken model. 
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Composition is viewed as an extension of writing and spelling where 
the production of^phrases and sentences is undtfr the control of pic- 
tures, questions , di rections or the child's own verbal behaviorJ 
The terminal behavioral objective of the composition program is that 
the child produce meaningful phrases and sentences in response to 
general directions. The core of the composition program requires 
the chi Id to: - 




read a question, attend to a picture and orally 
respond to the question in the presence of the 
teacher* He is then instructed to write the 
cinswer. It need not be a complete sentence . 




read a question, attend to a picture and orally 
respond to the question in the presence of the 
teacher. He is then instructed to write the 
answer in sentence form. 




read a question, attend to a picture and write 
the answer in sentence form . From this phase on 
the teacher only responds to the chi ld*s-wri tten 
answer. 



respond to a specific question. 



respond to general directions. 



Program progression is designed so that writing is maintained by spel 
ing and spelling is maintained by composition. 
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The reciprocal modification 

OF 

ARITHMETIC BEHAVIOR^ 
AND PROGRAM DEVELOPMENT^ 

Joseph a. parsons 



Arithmetic behavior may be analyzed as operant behavior (Skinner, 
f957). Table 1 illustrates the three-term interactional model (con- 
tingency) as it applies to arithmetic. Across, the top are shown the 
three components of the contingency: anteaedent events ^ arithmetia 
behavior, and' consequent events. Antecedent- events refer to the cue 



TABLE I. 

THE THREE-TERM CONTINGENCY IN ARITHMETIC 



Anteaedent Events 
(SD) 



■Avithmetia Behaviors 
(E) 



■Consequent Events 



® 


Countable objects 




Manipulation of sets 


® 


Social rei nforce- 












ment 


© 


Written & spofseq 


® 


Saying numbers and 


® 


"Intrinsic" rein- 


numbers 


signs 


forcement 




Written & spoken 


® 


Writing numbers and 


® 


Access to rein- 


e>^pressions of 


s igns 


forcers or escape 




operation 








or avoidance of 












aversi ve stimul i 




2 . 
±1 








"That's right!" 



or discriminative stimuli to which the child responds. Specifically, 
antecedent events include countable objects, written or spoken num- 
bers, and written or spoken expressions of mathematical operation* 
Arithmetic behavior, shown as the middle term, is comprised of count- 
ing or derivational responses. We might say someome is performing 
arithmetic if he Is manipulating sets of objects In reference to quan 



The author wishes to hank Ors. Sidney W. Bijou and Jeffrey A. 
Grimm for offering invaluable comments on the research and writing of 
the manuscript. 
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tity.^ Saying and writing numbers and operations are also arithmetic 
behavior. The complexity of arithmetic is due to the length of be- 
havior sequences (response chains) and not because the response ele- 
ments themselves are difficult to perform. One need only emit these 
relatively simple responses under the appropriate conditions. Com- 
plex problems require longer chains and more varied response elements. 
Designing instruction for arithmetic, then, involves stimulus control 
procedures more than response shaping. Therefore, the interaction 
between antecedent events and the behavior. wi 1 1 be of major impor- 
tance. Consequences which strengthen and maintain arithmetic behav- 
ior are reinforc-fng events. For arithmetic, as for. other classes of 
verbal behavior, the reinforcers are primarily social in nature.' Most 
commonly this includes praise from parents> and teachers (e.g., ''Good ' 
work,'' "That's correct," etc.). The child may also be reinforced byV 
manipulating the materials themselves as in playing with an abacus 
blocks, or playing cards; and a great deal of arithmetic is maintained 
by the access to positive reinforcers, or escape or avoidance of aver- 
sive stimuli (e.g., exchange of money for goods and services, telling 
time to make a rendevous, driving below the speed li^mit). 



PROGRAM ANALYSIS OF ARITHMETIC 

This paper discusses the development of a program to teach arithmetic 
to young developmental ly retarded children. It is a beginning pro- 
gram, requiring only a verbal imitative repertoire. Children may ^n- 
ter the program at higher loveh depending on pretest assessment of 
their entering repertoires. The terminal behavior of the present pro- 
gram is the solution of story problems, and is best described with^an 
example Item. Miss Castle has fourteen girls and twelve boys in her 
class. Only five of the children can paint at one time. How' many 
chl liren must wait to paint? Solving this problem requires many skills 
Obviously the child needs reading comprehension and writing skills as 
well as .a complex computation repertoire. Note that both addition and 
subtraction operations a.re required to solve the problem. 

In terms of the child's total learning environment, the most important 
reason for the selection of story problems as the terminal objective 
is that story problems, more so than straight computation, approximate 
making arithmetic functional for everyday living as well as the solu- 
tion of other academic problems (e.g., physics, chemistry, etc). Just 
as reading, writing, and spelling are useful for and maintained by 
solving story problems, so are story problems prerequisite or precur- 
rent to solving problems likely to be encountered in non-school set- 
tings (e.g;, buying groceries). 

Our children's arithmetic repertoires are assessed on enrollment to 
the Laboratory school. The eight children in the class could all verb- 
ally imitate the numbers 1-20, but could not count these numbers reli- 
ably or even name the numbers. The task, then, was to design a se- 
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quence of Instruction which would lead the children from their limit- 
ed entering repertoires - imitation of numbers - to the terminal ob- 
jective, solving complex story problems. Table 2 highlights several 
features of the program^ development in terms of the three-term in- 
teractional model « Along the top are the three interaction components. 



3. 



TABLE 2 



Anteceuent Events 
(S^) 



Arithmetic Behavior 
(R) 



Consequent Events 
(S^) 



1 , ^^Say s ixtee'n,** 



"sixteen" - 



"Good work" plus 
tokens on CRF, 



2,V^"Count from 
18 to 20," 



"E i gh teen , n i ne teen , 
twenty" 



"Nice counting" 
pi us tokens • 



39. A written story Read problems. Altered written 

problem. problems , 

Altered written Translation of numbers Problem in computa- 

problems. and operations into t tonal format, 

computation format. 

Problem in compu-- Computation chains and "Nice job, good 

tation format, ' solution responses, - ' work, etc," on 

VR 10. 



The numbers on the left represent program sequences, that is, sec- 
tions of the program designed to teach components of the terminal 
response. Sequence 1 is the entering behavior or skill level of the 
children on enrollment, verbal imitation of numbers. Sequence 39, 
at the bottom, shows an analysis, of a terminal- story problem. As 
the child moves through the program, the antecedent stimuli increase 
in complexity and form from a verbal "sixteen" to a written problem. 
The behavior also increases in complexity* While the terminal sol- 
ution response may still be sixteen, the chain leading to the solu- 
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tion has expanded in length and breadth* In the consequences column, 
reinforcement systematically decreases throughout the program from 
continuous social and token reinforcement to only occasionally sched- 
uled social reinforcement. The entire interactional sequence can be 
viewed as the development of arithmetic behavior and ^independence. 
That is to say, as the child progresses through the program, he can 
do more complex arithmetic problems with less teacher intervention. 

The initial development of the program proceeded from the terminal 
behavior back to the point where the children could enter and be 
successful. A task analysis was made of the terminal interaction 
(story problems) which isolated component arithmetic responses nec- 
essary to fulfill the final objective. These behaviors were ordered 
into an instructional sequence so that as the child progressed through 
the program he would master. the most basic skills first, and subse- 
quent behaviors would build upon the basic interactions as well as 
maintain, them in the child's repertoire* For example, in row. 2 is a 
segment of the second sequence, number" chaining or counting. Obvi- 
ously saying the numbers is prerequisite to saying numbers in a set 
order. Sequence 1 is precurrent to task 2, and task 2 builds upon 
and maintains the behaviors mastered tn the first program unit. Such 
an analysis was carried out from sequence 39 to sequence 1, 

The sequence of the actual program is shown in TabJe 3-' Fpr conven- 
ience, it has been grouped into three divisions: (1) precomputat ion- 
al arithmetic, instruction on prerequfstte behaviors for addition and 

TABLE 3 
SEQUENCE OF STIMULUS ITEMS 

Precomputational Arithmetic Skills 

1. Verbal chaining of numbers 

2. Counting number (sets) 

3. Discrimination of written numbers 

4. Naming written numbers 

Simple Computational Arithmetic Skills 

1, Finger counting for addition & subtraction 

2, Introduction of. zero 

3, Double column 

Arithmetic Comprehension 

L Story problems (-ties in with reading, 
writing and spelling programs) 

a. Translation of stories into computa- 
tional format for solution; both from 
auditory and written stories. 



® 
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subtraction; j2) computationaJ arithmetic, instruction on addition and 
subtraction; and (3) arithmetic comprehension, instruction specific to 
story problems. Since space -1 imi tati ons make it impossible to present 
all 39 sequences which make up these units, several selected units and 
monitoring data on four children are presented and discussed. 



PRECOMPUTATIONAL ARITHMETIC 

Precomputat ional arithmetic begins with instruction on counting for a 
child with an imitative repertoire. Figure 1 shows monitoring data 
on the counting sequence for once child, J. C. Intermittent reliabil- 
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Fig. I. Monitorfng data on the counting sequence for one 
child, J; C. In the top figure (counting accuracy), the 
upper curve, solid line, indicates overall accuracy; the 
lower curve, broken line, 1 rid icates unprompted accuracy. 
The lower graph shows progression through the counting se 
quence in term3 of chain length. 



ity of scoring was accomplished with the aid of a trained observer. 
Comparisons of counting accuracy, prompts, and reinforcement schedule 
yielded agreements on all measures above 30%. The upper curve, solid 
line, is the child's overall accuracy scores^ The lower curve, bro- 
ken line, indicates accuracy when prompted frames are scored as er- 
rors. Prompted frames are those in which the tutor gives hints to 
the answer. For example, in the counting sequence, the tutor may 
prompt the response "twenty*' by saying *'twaJ' Prompts, then, are 
, tutor-added supplements to the antecedent stimulijs. The difference 
between these two -curves indicates the extent the child Is dependent 
on the tutor's help. While the child's overall accuracy varied be- 
tween 70% and 30%, his unprompted accuracy showed a rather steady in- 
crease to the 30% mastery criterion in the lower curve. The lower 
graph indicates progression through the counti ng ^sequence. Longer 
chains were required for reinforcement as the child mastered shorter 
counts. The child became less dependent as he progressed through the 
program and his accuracy increased. 

The daily monitoring of the two accuracy measures was suggested by 
'the programming principle that pupils should make minimal errors; 
hence, be successful and reinforced a high proport ion- of the time 
(Skinner, 1968). The teacher can scrutinize these two data and de- 
termine the amount of prompti ng .that is necessary to keep the child 
successful and advancing toward independent behavior. 

The remainder of the precomputation .division of the program deals 
with counting objects, matching numbers to numbers, and naming num- 
bers. Example frames art shown in Figure 2. The three frames at the 
top under [Jurnbers and Sets are examples of exercise's which require " 
the child to match sets of objects , fi rst similar, then objects dif- 
fering in form and of increasing number. The middle two frames under 
timber Discrimination are examples of items which require the child 
to match written numbers. The last three frames under Number Naming 
are examples which deal with number naming. * These frames combine 
counting and matching to prompt identification of numbers. 



COMPUTATIONAL ARITHMETIC 

The second division of the program--s imple computational arithmetic 
skills--is concerned wi th 'i nstruction on addition and subtraction. 
Figure 3 shows data on the acquisition of addition and subtraction 
for one child, S. M. The top curves are overall accuracy scores. , 
The lower curves are unprompted accuracy scores. Here, again, 
prompted frames are scored as errors. Unprompted accuracy curves 
are a stringent measure of unit mastery. The first pair of curves 
under A show rapid acquisition of a finger-counting procedure for 
addition. The second pair of curves (BJ indicates expansion of add- 
ition to where both numbers varied from 1-19 with sums no greater 
than 20. The third set of curves; under £, shows acquisition of sub;r 
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Fig. 2. Example frames from precomputationa I arithmetic: 
the top three frames deal with numbers and sets; the middle 
tv;o frames, number discrimination; and the bottom three 
frames deal with number naming. 



traction behavior and maintenance of addition. Up to this point in 
£he program the child was selecting answers in a multiple-choice for- 
mat, circling written answers. The last pair of curves (D) shows per- 
formance on mixed addition and subtraction where the child was re- 
quired to const*^uct, or write his answer. The rapid mastery of this 
unit attests to the mastery of prerequisite arithmetic and writing 
skills. These data indicate two things. First, tliey indicate the 
beneficial role of prompting. Complex chains of responses (addition 
'and subtraction) were quickly developed by maintaining a high rate of 
success; hence, reinforcement (i.e*, high overall accuracy). Prompts 
were faded depending on the data until each unit was mastered to the 
90^ criterion (i.e., high unprompted accuracy). Specifically, when 

/ 
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* overall accuracy was above 85^, prompts were systematically deleted* 
If overall accuracy fell below 85?, we would temporarily back up, add- 
ing prompts to increase the chi1d*s success* Second, these data indi- 
cate *the effectiveness of the program. The lov/er set of curves is an 
accurate measure of the acquisition of independent problem solving. 
Teaching this child to add and subtract independently required twenty- 
five hours of instruction* - • ^ ^ 

The remainder of the, computation-division involves instruction on add- 
ition and subtraction in a vertical format, the use of zero, and sev- ' 
, eral units designed to increase the complexity of the problems to 
double columns and multiple rows* 
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Fig* 3. One child's overall accuracy (top graph) and 
unprompted accuracy (bottom graph) for four units of 
instruction on addition and subtraction* 
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Basic Research in the Context of Computational Ppcgram 

The following study compared the effects of two attending programs on 
the acquisition and maintenance of double-column mixed addition and 
subtraction. This is an example of basic research within the class-" 
room setting. Figure k shows characteristics of the two attending pro- 
grams and three problem types. Attending here, refers to some overt 
response to the + and - operation signs. PROGRAM A reinforced tfie 
child for circling the plus or minus sign prior to doing each problem. 
The attending response was the same for + and a circle, and was the 
same for beginning as well as terminal frames. The beginning frames 
in PROGRAM A were of type 1 and 2. It is obvious, even with the sign 
deleted, that problem type 1 is an addition problem because the upper 
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Fig. 4. Description of conditions for Attending 
Programs A and B (top) and example problems of 
Type 1,2, and 3, 



numbers are smaller than the' lower numbers. Type 2 problems are less 
revealing, but the childcen have not yet learned to carry and have 
been reinforced for writing only one digit per answer box. With these 
two restrictions, it is obviously a subtraction problem, even with tTie 
operation sign absent. Therefore, type 1 and 2 problems could b^ solved 
without paying attention to the signs present. The terminal problems in 
PROGRAM A were type 3 which require close inspection of the sign far ac- 
curate solution. Ignor-ing sign, they could be solved either by addition 
or subtraction without violating the child^s two •*rules.'^ Circling the 
signs was still required on terminal type 3 frames. 

PR03RAM B also reinforced the child for overt circling of the signs, 
but beginning problems also required the child to name the operation 
sign, plus or ni'nus, as weM as circle It. That is, PROGRAM B required 
the child to make two different responses to the signs while PROGRAM A 
required the samt. response. Problems were always of type 3 in PRO- 
GRAM B. Thus, the terminaKi tems for both PROGRAMS A and B were iden- 
tical, type 3, requiring circling only. ^ 

Data presented are on terminal Items. Figure 5 shows one chlld^s per- 
formance on these terminal items following initial histories on begin- 
ning frames of PROGRAMS A and B. After going through the beginning of. 
PROGRAM A, where only circling of sjgns was reinforced, the chiOd*s 
accuracy was low, averaging about 70%. All errors were due- to perform- 
ing the wrong operation. This was true even though on previ ous uni ts 
of the program she had -100% accuracy on addition ijnd subtraction! In 
between the fi rst two curves the child completed PROGRAM B. The child 
was reinforced for naming the sign for several sessions then switched 
to the terminal task,, circling only. It can be seen the program was 
effective. It was only necessary to initially reinforce different 
attending respons^ to the sign to increase accuracy to cri teri on,, and 
attending was thereafter maintained with ^..'^^y a circling requirement. 
The next two curves^ are a replication. Ag^in, completing PROGRAM A 
deteriorated the chjld)<; performance and the subsequent requirement 
to differentially name* the signs in PROGRAM B remediated, the problem. 

These results suggest that for attending to be optimal, the child must 
make more than an overt response; he must respond differentially to 
the materials. Reinforcing correct solutions was not enough to increase 
attending once It deteriorated (PROGRAM, A - terminal problems).' How- 
ever, reinforcing correct solutions did maintain efficient attending 
o.nce the-child had responded differently to the two operation signs 
(PROGRAM B) . Findings from this study were Immediately applied. The 
program was redesigned to eliminate problem types 1 and 2, and Include 
the differential naming response to the operation signs. Subsequent 
children going through the sequence have been successful. 




Fig. 5. One chi l<s alcuracy perf-ormance on terminal frames 
following histories>f Attending Programs A and B. 



ARITHMETIC COMPREHENSION 

The third di vision--ari thmetic comprehension--brings computation under 
the control of written sentences. Figure 6 shows a shortened sequence 
of this part of the program. Visual prompts are provided in the mater- 
ials and are gradually faded. Initially, boxes are provided for each 
digit needed as well as the operation sign. Also, the digits required 
rn the answer boxes are in the sentence just adjacent to the computa- 
tion area. At the same time 'Jiese physical prompts are being faded, 
the problems increase in complexity. Verbs expressing operation are 
expanded (e.g., *'put" and ''take" to ''finds" and "forgets"), numbers are 
written out, sentence length is increased, and the order of sentences 
is made more complex. 



SAMPLE STORY PROBLEM TYPES . 



take 



1 0Ses • 



forgets 



Fig, 6, Story problem frame format 
from the arithmetic comprehension 
program.^ 



Figure 7 represents one child's unprompted accuracy across daily ses- 
sions on the story problem sequence. With the exception of a few 
points, the sequence was optimal. On only several occasions was it 
necessary for the tutor to prompt this, child* This girl began the 
year unable to reliably count from 1-20, but nevertheless was able 
to master complex story problems after eight'months of instruction. 
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Fig. 7. One child's unprompted accuracy per- 
formance on the arithmetic comprehension pro- 
gram. 



SUMMARY 



"A primary arithmetic program is under development using behavior prin- 
ciples. Arithmetic behavior was analyzed as verbal behavior involving 
the three- terrn^ contingency. The unique features of arithmetic noted 
were: 
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Arithmetic involves chaining simple re- 
sponses into long sequences, and brings 
Ing these responses under the joint 
stimulus control of the numbers and op- 
eration signs* 

Arithmetic is a logical system with great 
potential for consistent reinforcement. z-*-"^ 
The. fact that solutions are easily checked 
by the child suggests methods to establish 
being correct as a reinforcer may be fruit- 
ful. 

In order to make arithmetic less boring, 
and provide maintenance for learned be- 
haviors, it should be Incorporated Into 
the child's daily life. This includes^ 
using arithmetic in school settings which 
provide a wider range of reinforcement 
than arithmetic alone (e.g., sciences), 
and in child's non-school habitat 
(e.g., buying goods and services) « 

Pn The program was developed- to -teach only 
those behaviors necessary to master the 
terminal objectives, and to teach these 
component behaviors in a sequence where 
each succeeding behavior built on inter- 
actions already mastered. Prompts were 
added, as needed for individual children, 
to keep reinforcement high. 

The data presented suggested how daily 
records were important in monitoring the 
children's progress and for making alter- 
ations in the program. 



The programming principles involved in the development and administra- 
tion of this program are equally applicable to more complex arithmetic 
behaviors. Jn fact, when children have larger behavior repertoires, 
it is. easier to vary materials and make computation more functional 
^for obtaining naturally occurring reinforcers. 
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A FINAL NOTE 



j.a. grimm 

I'would like to tell a story, the theme of whi'ch many readers are 
probably familiar. \/hen I was a freshman in college, I worked in 
a summer camp for physically handicapped and retarded children. I 
soon found that I was not expected » encouraged, or able to teach 
these children anything. Hy sole function was to keep them clean, 
warm, and comfortable. So, naturally, I became a psychology major. 
As a graduate student, I had occasion to visit a state training 
school for retarded children. I had, in the, meantime, encountered 
companies of rats in underwater maze?,, battalions of college soph- 
omores in front of memory drums, and armies of clinical students 
hotly debating the meVits of eclectic therapy. But, I found that 
the staff at the training school v/as not expected, encouraged, or 
able to teach the chi Idren anything. The staff's major function 
was to keep the children clean, warm, and comfortable. 

Bijou (1970) has posed the question, **What does psychology have to 
offer education - now?*' I think that the answer to that <iuestion 
is becoming increasingly clear. It is a concentration on behavior/ 
environment interactions^ It is a body of techniques for managing 
the setting, antecedent, and consequent events that comprise the 
child's learning environment. It is an optimistic attitude that 
thte retarded child can learn. But it is also hard work and very 
demanding of teachers. Teachers should not be misled fnto the be- 
lief that the behaviors required of them are easy. 

When plans for the Child Behavior Laboratory were formulated in 1965, 
curriculum materials that were both suitable for young retarded chil- 
dren and commercially available were non-existent. Today, most ma- 
terials for this population still suffer from two defects. First, 
there is^ little available evaluative data- concerning the remedial ef- 
fect of the material on the child. Second, available materials do 
not provide the teacher with sufficient procedural detail for their 
effective administration. The research presented in the preceding 
papers has been concerned with the development of both materials and 
procedures and with the evaluation of these products. 

Although the task is still incomplete, results to date indicate that 
psychology has a great deal more to offer education than a technology 
for keeping retarded children clean^ warm^ and comfortable. A brief 
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case history of a five year old girl named Laurie is illustrative* 
She was diagnosed as brain damaged and retarded » and eliminated from 
kindergarten for "failure to learn anything*" Indeed, Laurie could 
not count from 1 to 20, could not copy any letters, could not read 
any words (in fact, she could not even discriminate one group of let- 
ters from another J, and responded emotionally (i*e*, cried) to most 
academic tasks when she was first enrolled in the Laboratory class. 
As a consequence of the academic programs and procedures presented in 
the preceding papers, Laurie learned to add and subtract, mastered 
manuscript writing, acquired a fifty word spelling repertoire and a 
•sixty word reading vocabulary* She also learned to work accurately, 
for long'periods without contrived reinforcers and with only i ntermi t- 
tent teacher attention. She wi 1 1 be placed in a regular publ.ic school 
first grade classroom in the coming school year. Laurie, then, is rep- 
resentative of what psychology has to offer education now/ 
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The effects of 
a peer correction procedure 

ON THE 
ARITHMETIC ACCURACY FOR 
TWO ELEMENTARY SCHOOL CHILDREN 

mi nam t conlon 
^ Carolyn hall 
edwardm. hanley 

This study explored the^ effects of a peer correc- 
tion ^procedure on the arithmetic accuracy of two 
children with academic deficits. The ABAB experi- 
mental design included assessment of the peer 
corrector's daily performance. During the peer 
correction conditions, when the peer systematic- 
ally marked big, red £'s.by correct responses and 
ignored incorrect responses, .each pupil's accura- 
cy increased when compared with BaseJine cond'- 
tions. No change was noted in the peer's accura- 
cy during each condition. This study indicates 
the effectiveness of using school age children to 
provide positive consequences for academic accura- 
cy. 

Peer influence has been demonstrated to be an effective technique for 
modifying behavior In the classroom; e-.g., social behavior (Wolf, Hanley, 
King, Lachowicz and Giles, 1970) and academic behavior (Evans and Oswalt, 
1968; Burdett, 1969). In spite of successful changes reported In the 
behaviors of , the subjects In all studies there Is no measurement of the 
manipulator's behavior during any phase of the studies. 

In the present study, measurements v^ere taken not only of the dally 
academic work of the tutor's students, but of the tutor's dally work as' 
we 1 1 . • 



Subjects and Setting 

Three subjects were selected for the experiment on the basis of their 
scores In a series of pretests on arithmetic review examples. The pre- 
test was given to several students; then one student was chosen as peer 
tutor or corrector on the basis of a generally high hut variable score. 
The two other students were chosen as tutees on the basis of low, but 
variable scores. 
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The classroom contained eleven students between the ages of eight and 
ten. The students were placed in this room because they were below 
grade leveV in math or reading or both. 

The corrector was Tom, who had been in an ungraded classroom since he 
'began school because of lack of readiness originally and then because 
of poor achievement. He also seemed to tack self-control and, there- 
fore, was a constant discipline problem. He was in a low grade, three 
reader and working on grade level in math. 

Dick, age 9» had been in an ungraded situation for one year, in a 
regular classroom for two years, then placed again in an ungraded sit- 
uation because of a very low reading level. He was reading on a sec- 
ond grade reading level and on a fourth grade ^level in math. ^ 

Harry, age 9, had been in an ungraded situation for one year, in a 
regular classroom for two years, then placed again in an ungraded sit- 
uation because of reading comprehension deficits. He was reading on a 
second grade level and working on a fourth grade Jevel jn math. 

Each afternooQ the v^hole class was given a sheet of paper containing 
thirty review math examples similar to those, on the pretest. The sheets 
were paH. of a series arranged as a review^erci se but. of increasing 
difficulty as new facts became learned facts and then review facts. 
The ttacher instructed the students to complete as many as possible 
v/lthin the 20-minute period. 



PROCEDURES 

Baseline I 

The first six days was a Baseline period during which the review sheets 
were handed out and the instructions were' given by the teacher as usual. 
The only change that was made was that a permanent seating arrangement 
was established. This included seating the three subjects at the same 
table so that when the first experimental condition was introduced, 
additional, confusion would be minimal. 



Peer Corrector I 

During experimental' condi tion I, the teacher gave a stopwatch and an 
answer'sheet to the corrector, Tom, and explained the procedure to him 
and the two other subjects. At the end of six minutes Tom stopped the 
watch and, using the answer sheet, corrected the examples completed by 
Dick and Harry. This involved marki(jg a C_with a red penciPon the 
correct examples and ignori-ng incorrect or incomplete work. Tom then 
returned to his seat and resumed work. Dick and Harry could continue 
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work except when Tom was correcting his paper. The watch was again set 
in motion and when six minutes had elapsed the procedure would be re- 
peated. If time remained, Tom would correct for the last time at the 
end of the 20-minute period. 

Two days after the experimental condition was in effect, Harry asked if 
he could operate the stopwatch at a later period in the day. This re- 
quest was granted, contingent upon a 100% correct score on the math pa- 
per. 



Baseline 2 ' « ' 

To test the strength of the experimental conditions, the classroom teach- 
er removed the contingencies on day 18 and math period was returned to 
Baseline conditions for four days. 
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Fig. I. The teacher's daily record of each pupil's accuracy 
on arithmetic review examples during each experimental condi- 
tion. Tom (upper graph) was the peer corrector, while Dick 
(middle graph) and Harry (bottom graph) were the tutees. 
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Peer Correction II 

Because the experimenter was primarily concerned with effect^^of a 
peer tutor (corrector) on the math scores of the tutor and his sub- 
je '-s, it was decided to eliminate use of ' the stopwatch, contingent . 
on iOO^ correct scores, by anyone other than Tom who continued with 
this same procedure. On day 22, the teacher explained the difference 
^between the two contingency periods to the class and class was conduct 
ed under these conditions for the remainder of the school year. Dur- 
ing all conditions the teacher corrected Tom's paper and simply check- 
ed corrections made by Tom during the experimental conditions. - 

A second person occasionally observed the whole 20-mInute period, and 
checked the subjects' papers, 

RESULTS 

As Figure 1 shows, accuracy cn arithmetic worksheets Improved , for all 
three subjects during both experimental conditions as compared with 
accuracy during Baselines 1 and 1* 
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On days 10 and 11 Dick had been absent In the morning because of Ml 
ness and on day 12 he was dismissed early, when he complained of a 
headache. 
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■ DISCUSSION 



The results of this study demonstrate that a student can work success- 
fuMy as a corrector with peers with no adverse effects on his own 
»wor-lc.- In fact, the tutor's percent correct average improved during 
thft^experi mental conditions concurrently with his students. 



The first two days of the study required continuous monitoring by the 
experimenter to insure correct use of both the stopw^»tch and the an- 
^er sheet. The answer sheet proved to be no problem as it was turned 
fate down except during the correcting times and the stopwatch was ap- 
propriately operated by day 3. Once the trouble shooting was completed, 
occasional checks by the experimenter and daily reports from the class- 
room teacher were ample evi dence"^ that the experiment could be conduct- 
ed independent of adult supervision, Tom^ the corrector, ceased to be 
a'' discipl ine problem, at least during the. math peri od . ^Towards the 
end of the experiment he would demonstrate his arJthmetic competency 
by^rrecting the papers without using the answer sheet. 
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A BEHAVIORAL APPROACH TO 
REMEDIAL READING USING 
STUDENTS AS BEHAVIORAL ENGINEERSi 

jerry willis 
jeane crowder 
betty morris 



The- problem of children who read poorly has probably received as much 
attention as any other problem In education. Models for special pro- 
grams to remediate deficits abound. Many educators advocate correct- 
ing some underlying problem of which poor reading is assumed to be a 
symptom. Some advocate an emphasis on perceptual training (Silver, 
Hagin and Hersh, 1967); some use intensive phonetic practice to Improve 
reading (Tomatis, 1969) T and others provide linguistic remediation 
(Hayes, 196?) to improve reading. 

Recently, successful behavioral approaches to reading have also been 
described in the literature (Willis, Morris and Crowder, 1972; Staats, 
Mink^ and Butts, 1970; Gray, Baker and Stancyk, 1969). Generally, the 
behavioral approaches focus on shaping the target behavior, reading, 
and provide systematic consequences for appropriate reading behavior* 
A frequent question concerning the use of behavioral reading methods 
relates to their effectiveness ijiJthe absence of consideration of un- 
derlying causes such as a visual perceptual problem which Interferes 
with reading. To deal with this question the current study was carried 
out In a poverty area school, used a behavioral approach, accepted any 
student referred who had a reading problem, and made no attempt to diag- 
nose or remediate any problem other than a reading deficit. The program 
was supervised by the school counselor and managed by a paraprofesslonal 
hired by the school system. Two psychologists from the School Consulta- 
tion Project served as consultants. The training began In October and 
ended in Apr 1 1 . 



Subjects 

Ss were 43 children In grades 2 through 8 who read two or more grade 
levels below their grade placement or who were judged by their teachers 
to have serious readif>g deficits (e.g., a second grader who read at a 
first grade, second month level). These children all attended the same 
school in Birmingham, Alabama and would be labeled culturally deprived. 



The authors would like to express their appreciation to 
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as having a low socio-economic level, or poor. The mean I.Q. (Slos- 
son Intelligence Test) was 82. Although about 75 children worked in 
the program over the year only 43 remained at the school from the pre- 
test in October to the post test in April. 

Setting 

The school provided a regular c assroom for the project. Over the 
year the eighth grade Behavioral Engineers were encouraged to modify . 
the room as they wished. Bulletin boards, posters, and displays were 
made, and a rather dingy, dirty room was turned into a bright, clean 
work area. Children came to the room for thirty minutes of training 
each day. 



Method 

The program drew from several of the behavioral approaches referenced 
above. Students referred by teachers were given a short Individual 
I. (J. test (Slosson) and a short reading test (Slosson Oral Reading Test) 
by the school counselor. However,: no students were eliminated because 
of low I.Q. or extremely low reading scores. The remedial program it- 
self had four major components: 

^MATERIAL 

Interesting reading material individually prescribed for 
each student was available. Every child had material that 
was both within his reading ability and interesting. Chil- 
dren who were non-readers began with the Hebus reading pro- 
gram (American Gui dance Servi ces , Publishers Building, Cir- 
cle Pines, Minnesota 55014). Those with minimal skills en- 
tered the Sullivan Prograrmed Heading Series (Webster* Divi- 
sion, McGraw-Hill), while students with slightly better 
reading skills were assigned to the SHA Reading Lab (SRA, 
259 E. Erie Street, Chicago, Illinois 6O6II), the KnoD Your 
World and You and Your World newspapers (American Education 
Publications, Education Center, Columbus, Ohio 43216) or 
the Readers Digest Reading Series (Readers Digest Services, 
Inc., Pleasantvi 1 le. New York 10570). However, there are 
many "high-Interest, low vocabulary" books that would have ^ 
been equally appropriate, 

. ^ STAFF 

Twenty-three eighth grade students actually carried out the 
training. The only requirement for selection was that the 
student wished to participate and had a free period during 
the day. The eighth graders iHehavioral Engineers) received 



five hours of training In principles of behavior modifica- 
tion as theyapply to reading. Role playing, modeling, and 
behavior rehearsal were used extensively. The Behavioral 
Engineers (BE) divided themselves Into five teams and se- 
lected names such as Mod Squad and Fantastic Four. ,Each 
team had its own time during the day when its members worked. 
The BE were regularly observed by the school counselor, who 
used a checklist of 20 aspects of the remedial program (see 
Appendix A). The team with the highest ^^efflclency rat- 
ing'' received a large trophy which was displayed in their 
section of the room. Second and third place trophies were 




Fig. I. Pre- to post-treatment differences in reading deficit 
for the children taught by Behavioral Engineers (8th grade stu- 
dents), those in a regular remedial program, and those who re- 
ceived no reading instruction outside their regular classroom. 
Students in the behavioral reading program reduced their read- 
ing deficit while students in the other two conditions were 
actually further behind at the end of the 7-month training pro- 
gram. 
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also given so that only the two lowest teams received no 
recognition. Praise for good work was regularly adminis- 
tered to the BE by the counselor and psychologists. Twice 
during the year movies of the BE were made and shown to 
their homerooms in an effort- to give them recognition and 
status for excellent work. 

Although the BE worked with children from grades two' through 
eight for the first week, the paraprofessional who managed ^ 
the program worked with the 7th and 8th graders for the re% 
mainder of the time when relationships between the BE and 
children their own age appeared less positive than with 
younger children. 

^TUTORING TECHNIQUE 

The third component was a special remedial reading technique 
that emphasized Immediate rewards for successful reading. 
Each BE worked with a pair of students of like ability and 
reading level. As a student read, the BE provided a green 
plastic chip (American Guidance Services) for each sentence 
of five words or more read correctly, (in a few Instances 
children were rewarded for each correct word because of a 
very low rate of correct reading.) The BE also was taught 
to pair praise with the green chips and to show enthusiasm 
for successful reading behavior. When a student made an er- 
ror the BE corrected" the error and helped the student finish 
the sentence. Then he gave the student a red chip, and the 
other member of the pair was allowed to read and receive 
chips until he made an error. The student began with the 
sentence in which the error was made^ thus reinforcing at- 
tending while the other student read. If a student read ten 
sentences in a row correctly the reading task was automatic- 
ally transferred to the other reader. 

^DATA COLLECTION 

The final component was the daily collection of data. Each 
pair of readers counted his red and green chips at the end 
of the period and recorded the number on a record sheet. 
Praise was liberally given for progress. Competition was 
encouraged between readers in matched pairs but not across 
pal rs. 

Another major use of the data was in planning future work. 
If a pair of readers had an error rate near zero for several 
days, the BE moved them into more difficult material. On 
the other hand. If the dally data reflected a high error rate, 
the pair was placed In less difficult material. If one read- 
er consistently made the highest score the'palr was re-matched 
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Two pairs were broken up and taught on a one-to-one basts 
when the data indicated the competitive condition was riot 
effective for then. 



RESULTS 

Table 1 presents mean pre and posttest data for the 43 ctiildren in the 
Behavioral Reading Program. These data were evaluated using a technique 
described by Libaw-, Berres and Coleman (1965). Pretest reading scores 
were used to predict the progress of students during the 7-month pro- 
gram. Pretest reading scores ranged from 0,0 to 3 years, 6 months.' ■ A 
child who had made a yearns progress In two years of schooling was ex- 
pected to gain three months in the next six months. Of 43 students, 
only three failed to exceed their pr.evious rate of progress, a signifi- 
cant improvement (Sign Test x = 3, p<. 00003). 



TABLE 1 

MEAN TEST DATA ON THE BEHAVIORAL 
READING GROUP. 





TEST 


PRETEST 


POSTTEST 


DIFFERENCE 


1 . 


T 


T 


T 


•SLOSSCN INTELLI- 
GENCE TEST 


S2 






♦SLOSSON ORAL READ- 
ING TEST 




2.S t/ea/t.4 


+ 1.0 yzau 



Since the Slosson Oral Reading Test Is basically a test of word recog- 
nition,- there was a possibility that the behavioral reading program im- 
proves word calling skills without Improving comprehension. To test 
this possibility the first 23 students tested for the Behavioral Ready- 
ing Group were given the Peabody Individual Achievement Test, Reading 
Recognition and Reading Comprehension subtests. These students made a 
mean gain of 6.5 months on the Reading Recognition subtest and 6.3 
months on the Reading Comprehension subtest indicating equivalent gains 
in both areas. 

The Behavioral Reading (BR) Program was also compared to a Regular Re- 
medial Reading (RRR) Program staffed by a certified, degree holding 
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teacher. Students attended this program for thirty minutes a day in 
small groups of about ten. Originally, it was planned to compare the 
total BR group to the total RRR group of about fifty students. Pre- 
test data, however, revealed that the RRR group was composed primarily 
of children with mild reading" problems or no problem at all while the 
BR group was made up of children with more serious reading deficits. 
In fact, many of the children in the BR group were 'Vejects** from the 
RRR group, children cons idered too far behind or too stupid to profit 
from special help. The r'eluctance to accept children with serious 
reading problems was encouraged by a system-wide policy that children 
more than two years behind could not profit from the remedial reading 
program. The mismatch was further compounded by the experimenters' 
willingness to take anyone into the BR group. Forty-five percent of 
the BR group had I.Q.'s in the educable mentally retarded range (80 
and belw). For research purposes, thirteen students in the RRR group 
were matched as closely as possible with thirteen BR students. Table 2 
presents the pre- and post-reading test data for the matched groups. 



TABLE 2 



MEAl] GRADE LEVEL AND TEST DATA 
FOR THE THREE GROUPS. 



GROUP 


GRADE 


I.Q. 


PRE-SORT 


POST-SORT 


DIFFERENCE 







T 


f 


T 





Behavioral 
N = 13 



4.4 



79 



2.10 



4.00 



1.30 



Regular 
Remedial 
N = 13 



4.- 



S9 



2.9S 



'3.40 



.5S 



No Treatment 
N = 6 



6.1 



75 



4.25 



4.90 



.65 



Also included is a group of six students who were tested by the coun- 
selor but who were in no remedial program. Since this group was not 
matched, comparisons with the matched grouos must be considered tenta- 
t i ve. 
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Using the Sign Test the BR and RRR groups were not significantly dif- 
ferent in grade placement, or pre-reading test scores. However, 
the BR group did significantly better (Sign Test x = 2, p<,0k6) on 
the posttest, and its gain of 1 year and 3 months was significantly 
better (Sign Test x = 2, p<.019) than the 6-month gain of the RRR 
group. 

In comparing the two groups it should be remembered that any remedial 
program must, by definition, help correct the problem which brought 
the program into existence. To eliminate a reading deficit a remedial 
program cannot merely produce a gain in reading. A 6-month prograrn 
which produces a 6-month gain merely leaves the student no further be- 
hind than he was when he started. To be effective a remedial program 
must produce progress at an above average rate if the student is ever 
to overcome his reading deficit. Figure 1 presents the scores in the 
form of changes in the reading deficit of the child. The BR group 
made the seven months progress expected of "average" children and an 
additional six months progress on their reading deficit. The RRR group 
was actually slightly further behind at the end of the program as was 
the group which received no special program. 



DISCUSSION 

Even when the relatively crude pre to posttest data are used, the be- 
havioral reading approach was markedly superior to the regular remedi a 1 
reading program. Further, a cost analysis indicated the BR program 
cost about $18 a day while the' RRR approach cost the school system about 
$^5 a day for a comparable number of children. Money alone does not au- 
tomatically produce a better learning environment. 

The success of BR is perhaps as important for what it did not do as for 
wnat it did." BR made no attempt to provide compensatory training in 
underlying causes such as visual-motor deficits, psychol inguistic lia- 
bilities or gross motor patterning; no expensive or exotic materials 
were used; training of the teachers lasted about five hours rather than 
requiring a year or more of graduate training in education, and finally, 
no tangible reinforcers such as toys or candy were used. 

However, the BR program was not wi thout frustrations to the staff. A 
problem which quickly became apparent was the interest and sensitivity 
of the Behavioral Engineers. They took their efficiency ratings very 
seriously and were sometimes upset when they received a low rating. Al- 
though regular checks of the BE*s methods of teaching are probably val- 
uable, providing trophies for the teams may actually be detrimental be- 
cause the emotional responses elicited by them interfered with changing 
the students' behavior. 

During the last month of the program, some of the BE indicated they were 
becoming bored with the daily tutoring routine. To counteract this, BE 
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were given Wednesday as a free day* They worked four days a week and 
were allowed to leave their regular classes on the fifth day and come 
to the reading room to talk or play games. Another alternative might 
be to allow BE to work for 6- or 12-week periods with an option to con- 
tinue if they wish". Boredom, however, was not a problem with the chil- 
dren taught. They eagerly attended the sessions and spontaneously ex* 
pressed their enjoyment of the training. One of the consultants 
watched as a little girl, some weeks after the program ended, knocked 
on the counselor's door to^ask, ''Mrs. Morris, why don't we get to go 
to reading any more?" 

The fact that the BR program was carried out in a regular public school 
produced further problems. The path to Implementing something that 
does not fit the normal pattern of education is often strewn with- so 
many administrative hurdles that many innovations jiever make it through^ 
the maze. Some school administrators are very suspicious of outsiders. 
This suspicion, and sometimes outright hostility, is often well justi* 
fled on the basis of the school systems' previous experience. In fact, 
schools seem to be continually faced with a variety of pressure groups 
who advocate changes ranging from sens i ti vi ty training for first graders 
to teaching ghetto children judo and birth control techniques. The 
School Consultation Project has attempted to overcome the inherent and 
often justified resistance to innovation in the public schools by using 
a crude shaping process. First, professionals in the target schools iden- 
tify the target behavior. In the study reported here the school counselor 
•was concerned aboijt the large number of students who read poorly. Second, 
SCP helps the school develop and implement a small pilot project. In 
this case ten children were tutored in a corner of the school audi tori um. 
SCP sypplied all the material and loaned the school a paraprofessi onal to 
manage the program and collect data. The third step, if objective data 
show the pilot project is effective, is to expand and continue the pro- 
gram witb the school system accepting more and more responsibility for 
a successful program. Here, the school system was impressed with the pi- 
lot project data and supplied a room, the reading material, a paraprofes- 
sional, and a great deal of positive reinforcement from school administra- 
tors. School administrators are now considering expanding the model to 
all schools in the system during the coming year. However, it should be 
noted that school administrators responded primarily to the crude pre 
and posttesting data. The precise daily data had little impact. Be^ 
sides this function the standardized tests were of little use compared 
to the crucial daily data. 

In summary, the behavioral reading technique described here is simple, 
inexpensive, and most important — effective. The study joins several 
hundred other reports of tutoring in the literature. Many have been de- 
scribed in the book. Children Teach Children, by Gartner, Kohler and 
Riessman (1971). The bulk of the reports on tutoring collected little 
data and used relatively unstructured tutoring techniques, some based 
on the assumption that the "natural" warmth of the tutor is the most ef- 
fective approach. However, the log of one student tutor indicates tu- 
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tors who are not given specific tutoring techniques may develop their 
own : 



OCTOBER 25: Kim still reads too fast, 

OCTOBER 29 : Today I devised a way to slow Kim 
down. If he reads aloud too fast, 
I give him a red strip of paper 
for a speeding ticket* If be reads 
with expression, I give him a green 
strip. We are going to make a graph 
of the strips and try to have 't al I 
green* 

NOVEMBER 25: Kim does better alj the time* I 
swear he is smarter than me," 
(Fleming, 1969) 
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EFFICIENCY CHECK UST 



TUTOR: 


TEAM: 


date: 




















1 . 

Reading materials presen,t at beginning. 










2 

Tokens present. 










3 

Prases often when correcf 










^Shows enthus 1 asm. 










^Gives token after each corrprf rp<;Tinn<;p 




















^Corrects errors. 










^Corrects errors In therapeutic manner. 
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1 1 aii9 1 CI 3 icouiiiij Lu OLiier SLUoenL wnen 
error Is made. 










'^Gives red chip for error. 










"counts chips at end of session and records 
da ta . 










Counts with students. 










13 . 

Praises and encourages at counts. 










Replaces materials in proper place.. 










'^Allows student to begin with sentence in 
which the other student made error. - 










'^Helps student complete sentence with errors 
before transferring reading. 










Is on time. 










T5 — ~^ ' 

Does tutoring within acceptable noise limits. 










T9 : 

Does not quit before end of period. 










^Keep accurate records (dates & materials). 



Each item - 5 points; Perfect score - 100 points 
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Effects of peer tutoring 

ON THE SPELLING PERFORMANCE OF 
ELEMENTARY CLASSROOM STUDENTS^ 

K William Harris; James a. Sherman 
david g. hernlerson; melissa s. Harris 

The effects of an unstructured peer tutoring 
procedure on the spelling behavior of elemen- 
tary school children were investigated* V/eek- 
ly test gains from pre-test topost-te^t were 
consistently higher for tutored word lists 
than for comparison word lists. Control con- 
ditions suggested that interaction between 
students during the tutorial period was re- 
sponsible, in part, for the improved spelling 
performance. Later retests of tutored and 
comparison word lists showed that the effects 
of tutoring were still evident after several 
weeks, although at a reduced level. Systema- 
tic replications showed the tutoring procedure 
to b^ effective in several different elementary 
grades. 



INTRODUCTION 

The use of students to tutor other students In academic subjects Is 
being Increasingly used and advocated (Fleming, 1969; LIppItt, 1969; 
Rossi, 1969; Thelen, 1969; Archlbeque, 1970), particularly I n situa- 
tions where high student-to-teacher ratios limit the amount of Indiv- 
idual instruction the teacher can provide. "Several published studies 
(Horst, 1931; Cadltz, 1963; Ellson, Barber, Engle and Kampwerth, 1965: 
Hassinger and Via, 1969; Taylor, 1969; Landrum and Hartin, 1970), as 
well as several papers Vead at this conference have Indicated that the 
use of students to tutor other students may result in Improved academ- 
ic performance by these students. We attempted to add to our know- 
ledge about student tutoring by evaluating the effects of an unstruc- 
tured peer-tutoring system upon the students' performance on spelling 
exams and to compare the effects of peer-tutoring to the effects ob- 
tained when students studied Individually. 



This research was supported by Grant OEG-0-8-522422-4433 from the 
United States Office of Education to the University of Kansas Support 
and Development Centf^r for Follow Through. We thank Dr. Don Bushel I, Jr 
for his support and 6«;sistance and Harold Siegrist, principal of V/ood- 
lawn School, Lawrence, Kansas, and the entire staff at Wood I awn School 
for their cooperation In this investigation. 
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METHOD 

Subjects 

The majority of the experimental conditions were conducted in a fifth 
gj^^^k-c lass room composed oi'twenty students. Pr^or to the initiation 
of ^Is study the class had scored a mean of S ^ years on the spelling 
component of the Iowa Test of Basic Skills. According tc the teacher, 
a second-year intermediate instructor, the majority of :he class had' 
consistently scored less than 7S% correct on- spelling exams given after 
completion of the spelling lesson progranimed for»the week. 

Syst^iiatic repl I cati^ons of one of the conditions performed in the fifth 
sj^'ajfi^ classroom (the tutoring cc^ditions) were conducted in four addi- 
tional'^x lass rooms. A combination second/th i rxJ grade classroom (2^ stu- 
dents), a combination fourth/f i f t.; grade classroom (25 students), and 
two sixth grade classrooms (22 and 21 students respectively) were se- 
lected. Mean class scores on the spelling component of the Iowa Test 
of Basic Skills, administered at the outset of the year, for each class- 
room are listed in Table 1. 



TABLE I 

SCORES ON SPELLING COMPONENT OF THE IOWA BASIC SKILLS 
ADMINISTERED AT THE OUTSET OF THE YEAR FOR THE VARI- 
OUS CLASSROOMS, " 

^SCORC = GRACE 
LEVEL EQUIVALENT 

No T(Ut I 3.0 ■ 
5.1 I 4.7 
5.1 
5.2 



"j'he effects of a tutoring system and an individual study system on 
spelling behavior were investigated in a fifth grade classroom At the 
outset of each week (Monday) students were administered two 20-wofd 
preTtests, one list after another. Word lists were drawn from BOOK D 
of the Bote) Spelling Series. 'During the davs intervening between pre- 
and- post-tests , students worked on assignments related to both 20-word 
exams 7^^lflf\ese assignments were drawn from BOOK D of the Botel Spelling 
Serjji^ At the end of each week (generally Friday) students were again 
admiWistered the same two 2G-Wdrd exams (the post-test) that were givea 
on ft&nday of that week. Spelling word lists were changed every week. 

4 " 



GRADE LEVEL 

1 . Combination 2/3 

2. Combination 4/5 

3. 

4. 6b 
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During the first three weeks In the fifth grade classroom the effects, 
of a tutoring system on spelling performance were observed* Ten min- 
utes, prior to administering one of the post-tests, students were given 
the list of words which comprised one of the 20-word tests, and were 
allowed to arrange themselves In small groups to tutor each other. 
The teacffer simply told the students to arrange themselves In small 
groups of from two to four students and to help each other learn the 
words • The teacher gave no additional Instructions as to how the stu- 
dents were to help each other learn the words. On the basis of ^obser- 
vatloh of the tutoring groups, a variety of things occurred. Occasion- 
ally one student within a group would serve as spelling examiner for 
the entire 10-mInute tutoring period. More frequently, however, each 
child within the group would participate as spelling examiner during 
the tutoring session. Typically, students would write the spelling 
words as the examiner (tutor) called out the words from the spelling 
'lists. Then, witWf^each group, students would compare answers and 
make appropriate^^ orrections. Sometimes, particularly when the group 
was composed' of only two students, the examinee (tutee) would vocally^ 
respond to words presented by the examiner (tutor). 

On the post-test, the tutored list of twenty words was sometimes tested 
first and at other times second. Whether or not the tutored word list 
was post-tested first or second, the 10-minute tutoring period always 
immediately preceded the test on the tutored list of twenty words. 

f i 

During the three weeks in which tutoring was employed, spelling perfor- 
^mance on the tutored list of twenty words was compared to spelling per- 
formance on the list of twenty words which v/as not tutored. The list 
chosen for tutoring was determined by a coin flip. 

To evaluate whether the effects of tutoring were due to interactions 
between st.L^ents during the 10-minute tutoring sessions prior to the 
post-test, or simply the opportunity tha^t students had to study one 
list for ten minutes prior to the post-test, an independent study con- 
dition was arranged for three weeks. — ^In the I ndependentfestudy condi- 
tion, each student was given a list of words which comprised one of 
'20-word tests ten minutes before the post-test on that list of words. 
The students were told to study this list of wordsy individual ly. All 
other procedures remained the sime as in the tutCTlng conditions. The 
list^f words chosen for independent study was determined by a coin 
flip. 

Following three weeks of the independent study condition, a series of 
one-week conditions were employed as follows: tutoring^ independent 
study^ tutoring^ and independent study. 

Tutored and comparison word lists and independently studied and com- 
parison word lists were retested from two to five weeks following admin 
istration of" the post-test in the fifth grade classroom. This was done 
to evaluate^the possible effects of the tutoring and independent stpdy 
procedures over a somewhat longer period of time. 
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To evaluate whether the effects of the tutoring procedure were repli- 
cable across different classrooms, the same tutoring procedures em- 
ployed in the fifth grade classroom were used in a combination second/ 
third grade classroom, a combination fourth/fifth grade classroom and 
two sixth grade classrooms. These procedures were in effect for one 
week in each classroom. As in the fifth grade, two 20-word spelling 
tests were pre- and post-tested for three of the classrooms during this 
week. In one of the classrooms (the combination second/third grade), 
two 10-word spelling tests were used. 

Each student^s spelling pre- and post-test was graded and returned on 
the same day that the test was administered. A percentage correct was 
determined for each student on each word list as well as a mean per- 
centage correct for the entire classroom on each word list. The mean 
percentage correct for each classroom was* determi ned by dividing the 
total number of correct words spelled for all students in the classroom 
by the total number of words possible for all students in the classroom. 
No attempt to spell a word was scored as an incorrectly spelled word. 

Pre- and post-test grading reliability was assessed at least once during 
each of the conditions in the fifth grade classroom. A pre- and post- 
test grading reliability check was completed for each of the other four 
classrooms during the only week in which spelling performance was ob- 
served. The degree to which two independent graders agreed on whether 
a word was correctly or Incorrectly spelled was determined by dividing 
the total number of words (for all students) agreed upon by the total 
number oF words possible (for all students). Reliability scores for 
the pre- and post-tests on both the experimental and comparison word 
lists averaged 33% across:all of the conditions conducted in the fifth 
grade classroom. Reliability scores for the pre- and post-tests on both 
word lists also averaged 33% In the other four classrooms. 



RESULTS 

Mean classroom percentage scores were calculated over all students that 
took both the pre-test and post-test during any given week. Weekly 
classroom gains from pre-test to post-test for each set of twenty words 
are displayed in the upper graph of Figure K Weekly test gains of the 
tutored or individually studied lists of words are represented by the 
solid line. The comparison list of words for each week is represented 
by the dotted line. Bars in the lower graph of Figure 1 represent the 
classroom test gains of the tutored or independently studied word list 
over the comparison set of words tested for that week. 

During the first three weeks of the study the tutoring procedure was 
used for one set of twenty words. The post-test gain for the tutored 
set of words ranged from \^% to 25% greater than the post-test gain on 
the non-tutored set of words over the three weeks. During the next 
three weeks one list of words was studied Independently for the same 
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Fig. I. UPPER SET OF AXES: mean percent correct for all stu- 
dents on each weekly pre-test and post- test for tutored, inde- 
pendently studied, and comparison word lists. LOWER SET OF 
AXES: mean percentage point gain for tutored or independently 
siudied word list over the comparison word list during each 
week. 
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amount of time as one list had been tutored in the first three weeks. 
The independently studied list of words gained from 1% to 3% over the 
comparison lists of words on the post-test over these three weeks. 
When the independent study procedure alternated with the tutoring pro- 
cedure each week, the post-test gains for independently studied words 
were 8^ and larger as versus the comparison words, while the gains 
for tutored words were 23^ and lk% higher than for the comparison 
words • 

Figure 2 shows the percentage of students scoring within ten percentage 
correct intervals on the post-tests over all tutored and independently 
studied word lists. As shown in this figure, more students scored 
higher on the tutored word 'lists than'on the individually studied word 
lists, although there were also slight differences in the initial pre- 
test scores for tutored v/ords as compared to the individually studied 
words. The mean accuracy over alPpre-tests for tutored words was kk% 
and was ^0^ for individually studied words. 
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Fig. 2. Percentage of students scoring within ten percentage- 
correct intervals on the ppst- tests for all tutored and inde- 
pendently studied word lists. 
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A tutored or independently studied word list and the appropriate com- 
parison word list were retested from two to five weeks following admin- 
istration of the post-test procedures. This retest procedure provided 
data for determining the effects of the tutorial and individual study 
procedure on retention. These results are shown in Table 2. 



TABLE 2 

PERCENTAGE CORRECT ON TUTORED, INDIVIDUALLY 
STUDIED AND COMPARISON WORD LISTS WHEN RE- 
TESTED. 



WEEK OF 
PRE-POSl 

TEST .CONDITION PRE-TEST POST-TEST RETEST RETEST 



PRE-POST MEAN CLASSROOM PERCENTAGE ^^^^ 



@ Ta-tomd La>t 33 6S 49 'S 

Compafiiion Uit 3S ^ 4S 41 

0 TvutofLdd LiAt 52 77 66 ' 11 

CompMAAon lUt 57 59 59 



(D Individual Studij 

UAt 40 61 49 

CompafUion LUt 41 53 54 



(?) IndividucLl Study 

. LUt 35 52 44 1 1 

Com}3afUion liAt 41 '49 42 

A A A 



Both tutored sets of words retested maintained higher mean percentage 
scores than their respective retested comparison word list. However, 
decreases in mean classroom scores from post- test to retest were greater 
for tutored words than for comparison word lists. One list of retested 
v/ords that had been independently studied maintained a slightly higher 
mean accuracy than the comparison word list. The other retested list 
of individually studied words dropped to an accuracy lower than the com- 
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parlson word list. Like the tutored word sets. Individually studied 
words showed greater decline from post-test to retestn:han did compari- 
son word sets . 

The procedures of the tutoring system used In the fifth grade classroom 
were replicated In four separate classrooms. Figure 3 shows the pre- 
to post-test gains for each of the four classrooms selected for study. 
Solid lines indicate the gains made on the tutored list of words.- Dot- 
ted lines indicate the gains made by the comparison list of words. The 
bars at the base of each graph display the mean percent pre- to post- 
test gain of the tutored list of words over the comparison list of words. 
In each of the four classrooms tutored words showed a larger gain from 
pre-test to post-test than the comparison word lists. Tutored words In 




WK^l * -A-K.l WK.l aK.I 



tutcred cckparisoi. 
acM) list 'i^rd list 

Fig. 3. Mean percent correct for all students in each of four 
classrooms on the pre-test and post-test for tutored and com- 
parison word lists. The bar at the base of each set of axes 
represents the mean percentage point gain for the tutored word 
list over the comparison word list. 



230 



the combination second/third grade classroom showed a 23% gain over the 
comparison word list. In the combination fourth/fifth grade classroom 
tutored words scored a \6% gain over the comparison word list. In class^ 
rooms 6a and 6b tutored words scored gains of 23Z and 20Z respectively. 



DISCUSSION 

The present investigation evaluated the effects of a tutoring proce- 
dure on the spelling behavior of elementary school children. Weekly 
test gains from pre-test to post-test were consistently higher for 
tutored word lists than for comparison word lists. Independent study 
control conditions indicated that the effect of the tutoring procedure 
could not be attributed solely to the opportunity that students had to 
study one list for ten minutes prior to the administration of the post- 
test. Retests of tutored word lists and their respective comparison 
word lists showed the tutoring effects to be maintained over a tour to 
five week period, although at a reduced level. Systematic replications 
of the tutorial procedure in several additional classrooms indicated 
that the tutorial procedure was effective across a large number of stu- 
dents in several different elementary grades. 

Because the tutorial procedure was relatively unstructured (i.e., the 
teacher simoly asked the students to help each other learn the words) 
it was impossible to distinguish between the differential effects the 
tutorial procedure may have had on the tutor or tutee per se. Other 
investigators, however, have reported that a tutorial procedure may be 
effective in producing academic gains for both the tutor and the tutee 
(Landrum and Martin, 1970; Hassinger and Via, 1969). 

One characteristic of the tutorial procedure potentially responsible 
for the behavioral effect was the feedback given by students to other 
students regarding the correctness of a spelled word. Immediate feed- 
back occurred particularly when a tutorial group was composed of only 
two students where the tutee. wouLd vocally respond to words presented 
by the tutor. Less immediate feedback occurred when the students wrote 
the spelling words as they were called out from the spelling list. A 
second characteristic of the tutorial procedure potentially responsible 
for the effect was writing or spelling out loud the words to be tested 
prior to the test situation. 

An important characteristic of the present tutoring procedure was that 
it required little time and no addlfional materials to implement. All 
of the teachers who used the procedures found them both practical and 
convenient and advocated their continued use. The fact that^the tutor- 
ing procedures seemed, to work l,\ the absence of specific training pro- 
cedures for tutors, suggests that elementary school students already 
have some tutoring skills, at least in areas such as spelling where 
drill and repetition may be useful teaching techniques. Similarly un- 
structured tutoring procedures appeared to be effective, however, in 
other subject areas employing older student tutors (Horst, 1931; 
Caditz, 1963; Hassinger and Via, 1969; Landrum and Martin, 1970; 
O Taylor, 1969). 
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Effects of 
having one remedial student 
tutor another remedial student ^ 

michael davis 



Because of increasing demands on the professional teacher and because 
educators are becoming more responsive to stijdent needs for individual 
tutoring, paraprofess iona 1 teacher aidesT^parents, and college students 
have been used increasingly to supplement the public school teaching 
staff. Another source of manpower for the teaching staff is other stu- 
dents who have already mastered the material to be taught or who have 
been especially trained and equipped as contingency managers (Surratt, 
Ulrich, and Hawkins, 1969)- Other procedures for using students as 
teachers simply employ classroom contingencies that result in peer tutor- 
ing (Conlbn, Hall, and Hanley, 1972; Hamblin, Hathaway, and Wodarski, 
1971)- In some cases special training has been provided for students to 
manage the contingencies of their peers (Bailey, Piotrowski, and John5/On, 
1972; Harris, Sherman, and Henderson, 1972; Willis and Crowder, 1972) or 
both peers ^nd teachers (Graubard, Rosenberg, and Miller, 1971) • At 
this point it is interesting to note that all these references are to 
papers from either the 1971 or 1972 Conference .on Behavior Analysis in 
Education with the exception of the Surratt stu3y. 

The use of one student to teach another student would be a particularly 
appealing procedure if the teaching-student (the tutor) were to show 
some improvement in the quality of his academic behaviors as a result 
of assisting others. The present project employed a remedial student as 
a tutor of other remedial students and observed changes in the quality 
and quantity of the tutor's academic performances and changes in the 
quality of the performances of his students. 



METHOD 

Sub^eotQ 

The two tutors or contingency managers were sixth grade boys who scored 
at least two grade levels low on the Stanford Achievement Test (SAT) and 



The author wishes to thank Mr* K. Schlappi, Mrs. G. Price, and 
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were judged by their teacher to be remedial students. The SAT scores 
(reading scales) for these two boys and their ages are shown in Table 



TABLE I 

MANAGERS' AND STUDENTS' AGES (IN PARENTHESES) 
AND STANFORD ACHIEVEMENT TEST SCORES (SAT) 



^Manaaevs SAT 
\ \ 

❖Kevin (12) 3-6 



Students 
\ 

<8>Edith (8) 
<S>Mark (9) 



SAT 

M 

.6 
1.8 



❖Curtis (13) 2-2 



❖Johnny (9) 
^Rick (9) 



1.2 
1.8 



The SAT scores were grade-level scores relative to a grade-level norm. 
The student managers were each responsible for two third grade students 
who were also judged to be remedial reading students. The ages and SAT 
scores for these students are also shown In Table I. 



Dependent Variables 

The measure of academic performance was the number of answers to ques- 
tions and exercises provided In the Science Research Associates Reading 
Laboratory Power Builder (SRA)' series of programmed materials (Parker 
and Scannelt 1961) • Two summary Incllces were calculated from the number 
of answers. First, the percent of items completed on any school day was 
calculated by dividing the total number of Item answers by the total num- 
ber of possible answers. Second, the percent correct answers was calc\i- 
lated dally by dividing the total number of correct answers by the total 
number l< answers that were possible. The percent completed Index Indi- 
cated the quantlty^of performance, and the percent correct Index indi- 
cated the quality of performance. Written responses (answers) were re- 
quired of the tutors at all phases of the project. Spoken or written 
responses, were required of the students depending upon the phase of the 
project. 



Reliability 

The students* spoken answers and the tutors^ praise responses (conse- 
quences) were tape recorded during the students* tutoring sessions for 
subsequent independent rating by two raters. Indices of agreement were 
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calculated by dividing the number of rater agreements of studen^t answers 
or tutor consequence responses by_the total number of possible'^RA 
answers or total number possible, appropriate consequences. These in- 
dices of agreement could range from 0.00 to 1.00 with 1.00 indicating 
perfect agreement. The indices were calculated daily and ranged from 
.82 to .98 with a median index equal to .89; Written answers to.SRA 
exercises were graded by the students* or the tutors* teacher or by the 
tutors and were checked again by one of the raters. Three discrepancies 
between a rater and a teacher occurred out of over five thousand answers, 
and eight discrepancies between a manager and a rater occurred out of 
over four hundred answers. 



Manager Training and Tutoring Contingency 

The managers were trained to tutor by having the raters and the author 
model and' tutors engage in role playing correct and incorrect student re- 
sponses and appropriate and inappropriate praise consequences and prompt- 
ing responses. The praise responses were taken from lists of spoken 
approval responses as described by Madsen and Madsen (1970, pp-. II6-II8). 
Prompting responses generally involved providing the student with a, spoken 
cue that had phonic similarity or a similar meaning to the correct answer. 
Answers provided by the student following a prompt by the manager were not 
counted by the raters. 

The managers were told that their teaching would be evaluated by the raters 
who would listen to the tape recordings. The managers were eva luated on 
the basis of. how well they: 

(1) identified thecorrect answers; 

(2) praised or token- reinforced those answe rs ; 

(3) provided appropriate prompts when the stu- 
dent erred; 

{k) escorted the third grade students to and 
from the tutoring room; and 

(5) set up the tutoring room for use. 

If the tutors completed all their assignments they were awarded a maximum 
of 25 p oint s per day. Failure to reinforce correct answers, put chairs 
away, c(Qjp§^ forth, resulted in a reduction of that amount of points. 
The points earned by the tutors were accumulated until the end of the pro- 
gram. The tutors were told that they could arrange to exchange their 
points for a field trip or some comparable activity at the end of the pro- 
gram. 
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The Tutoring Program 

The tutoring program consisted of daily one-to-one contingency manage- 
ment sessions where the students were required to provide spoken answers 
to SRA exercises. These sessions were held in a storage room where 
teachers^ materials were stored and where teachers prepared visual aids 
and curriculum materials. The tutor sat facing the student who was 
seated in a tablet armchair. To the right of the student was a 12 Inch 
square vertical wooden panel on which a microphone and a plastic token 
receptacle were mounted. The two tutors worked simultaneously, and each , 
tutoring session v/as recorded on a separate channel of a two channel 
tape recorder. The tutor-student pairs were separated by a four foot 
high storage cabinet so that visual contact between pairs was impossible 
and auditory noise was minimal. When the student completed all exercises 
in the assigned SRA booklet the tutoring session was terminated, and the 
student returned to his classroom. 

The program was conducted as a series of manipulations in contingencies 
that affected the behavior of the student, the tutor, or both. The stu- 
dent contingencies had to do with the scheduling of praise and token conr 
sequences and the setting in which the student completed the SRA w%cr- 
cises. The tutor contingencies had to do with scheduling of events that 
were potential reinforcers or accelerators of academic performances in- 
cluding, free time from the classroom and practice at the SRA materials. 
The sequence of phases of the program has been briefly summarized in 
Table 2, and the procedures in each type of manipulation are described 
below. Briefly there were four types of procedures involved in the 
project. 

!► BASELINE - The tutors were instructed to make no 
response or* a neutral response to the itudent^s 
answers. Neutral responses consisted of asking 
the student to answer the next item In the exer- 
cises. At the end of the session the tutor an- 
nounced, "Okay, it^s time to go back to your 
rcx)m»" The tutoring contingencies were in effect 
for the tutors. 

2 ► REINFORCEMENT - During all 'reinforcement phases 
the tutor consequated the student ^s correct^re- 
5:ponses on a compound schedule where every c6^ 
rect response was praised and every fifth correct 
response was reinforced with a token. That is, 
a compound continuous praise, fixed ratio five 
token schedule (comp CRF PR 5) was in effect. 
The tokens were exchangeable for nonmaterial back- 
up reinforcers in a token economy in the third 
grade classroom. All other procedures were the 
same as during baseline, anb the tutoring contin- 
gencies were in effect for the tutors* 



3^ EXTINCTION - Extinction procedures were a return to 
baseline conditions of praise consequation. However, 
either of two conditions of token reinforcement were 
employed: the FR 5 was continued (as in Extinction II 
in Table 2), or token reinforcement was discontinued 
('•e., token extinction as in Extinction I in Table 2). 
Under the token extinct. on condition the tutor told 
the student, "Today I can^t give you any tokens for 
correct answers." The ttjtoring contingencies were in 
effect for the tutors. 

4^ NO PROGRAM - No program procedures involved instruct- 
ing the tutors and the students that the third grade 
teacher wanted to watch the students work for a while. 
The students provided written answers to SRA exercises 
in the classroom, and no praise consequences were 
scheduled. Either of the two conditions of token rein- 
forcement was employed, FR 5 or extinction. During no 
program phases the tutoring contingency was altered in 
one of several ways as follows: 

U ho Program I - The tutors were told that the 
teacher wanted- to watch the students work and 
that the program was going to be discontinued 
for a while. The tutors continued to i j as- 
signed SRA exercises in their own classroom 
during all No Program phases but they were 
not allowed to leave the classroom. 

2« Ih Program II - The tutors were told that the. 
teacher wanted to watch the students work, 
but that the raters could use their help in 
the third grade classroom. The tutors were 
given a contrived task that Involved tran- 
scribing numbers from one type of form to an- 
other form. This procedure allowed the tutors 
to have free time from their classroom contin- 
gent upon completion of their SRA exercises. 

3# No Program III - The program was discontinued, 
the tutors were told that they could again 
help the raters, and th#» task th^y helped with 
was scoring the third grade students* SRA exer- 
cise answers. This allowed the managers to 
have practice with the SRA materials in addi- 
tion to contingent free time. 
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TABLE -2 : SEQUENCE OF PROGRAM- PHASES and 
CONTINGENCIES ■ 

PHASE OF STUDENTS' ~. / MANAGERS'' 

PROGRAM CONTINGENCIES \ CONTINGENCIES 

^ Praise Tokens 

1 . BASELINE axt^i .... (Lxt Tutoring. 

- Contingency (TO 

2. REINFORCEMENT I c^jj** FR 5*** TC 

3. EXr.lNCTION I axt ex^....'. .-.TC 

4. RE^FORCEMENT^II ... FR 5 TC 

5. e;;(tinction i i axt FR tc 

6* NO PROGRAM I QXt FR 5 ".•.Returned to 

' * Classroom 

7. RErNFCRCiMENT III FR ,5' TC 

8. NQ PROGRAM II oxt Q.xt Free T-ime from 

C I OSS room 

9. EXTINCTION I I I ex£...... zxt fC 

10* NO^ROGRAM II I ex.t...... (Lxt\ VkoMd i 



Conti ngencies 

plus 
SRA Practice 



IL REWORCEMENP IV ....cj4 FR 5.«, TC 

12, NO PROGRAM IV dxt FR 5 Vka/^d 10 



Coni i ngencies 
plus 



' Points 
13, REINFORCEMENT V■;T.■.^GA(( FR 5 TC 



J^e)ct - extinction procedure ^ 
-¥'-¥'CA|5 - continuous reinforcement procedure . 
I^^-V'FR 5 - rei nforcemeTit of every fifth correct* 
response 
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RESULTS 

Student Perfomanae- 

The effectiveness of the program as a teaching procedure' was evaluated 
in terms of the qualjty of per-£ormance by the students. These data are 
shown in Figures 1 and 2 where the percent correct responses have been 
plotted for each daily session. Also, shown are the percentage ofcor- 
rect responses that were praised by the tutors _^(triangles) . The^rTPse 
da^a shown are average percentages for blocks of five sessions. The 
percentage of correct responses that were cbnsequated with praise during 
reinlWcement phases- and during extinction phases were very similar to 
the definitions of continuous reinforcement (100^) and extinction (O^) . 

The first series of experimental manipulations shown from left to right 
on Figures 1 and 2 was an 71 - 5 - .4 - 5 sequence where Baseline and 
Extinction I were the A conditions and Reinforcements I and II phases 
^ere the B conditions. All s^tudents except Mark improved above baseline 
to near perfect (100%) perfarmance during Reinforc^ient I, and Mark's 
performance was considerably higher than during baseline. Removal of 
the token and praise consequences during Extinction I resulted in a decre- 
ment in the quality of performance of all students and remstating the 
program cont ingencies during Rei?7forcement II resulted pn recovery of 
previoip reinforcement phase ifuality of performance. Tfiat is, the pro- 
gram contingencies in effect during reinforcement phases cons i s tent 1 y re- 
suited *in high quality performance as compared to baseline or extinction 
phases . 

The next series of manipulations was instated to evaluate several varia- 
tions of the tutoring program involving either the removal of the praise 
consequences or removal of the praise consequences and changes in the» 
setting in which students completed their SRA exercises. This sequence 
was the Reinforcement II - Extinction II (FR 5) - No Prcgram (FR 5) - 
Reinforce^nent III series in which the reinforcement phases were the com- 
parison conditions. For all students the removal of the praise conse- 
quences during Exii'ucti.^K V resulted in a decrease in the quality of 
performance relative to the reinforcement phases. Instituting the /Vo 
Program phase involved haN'ing the students write answers tfo the SRA ex- 
ercises in- the third grade class room wi thout having the tutor present. 
In addition, there was approximately a 20-minute delay irpthe delivery 
of tokens. The quality of performance of all students except Edith's 
ffell 'below the preceding extinction phase levels and the reinforcement 
pha^e levels. Edith*s performance remained below fhe level of quality 
obtained during the reinforcement phases. .These results indicate that 
removal of praise consequences disrupted the high-qual i t.y levels of per- 
formance mairTtained by the program contingencies. 

A clearer picture of the effects of changes In the setting was obtained 
in the next sequence of manipulat ions where the token reinforcement 
contingencies were not confounded in the manipulations. This sequence 
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Fig. L Percentage correct SRA performances by the third grade 
students and percent of correct responses that were praised by 
the tutors. The percentage correct data are shown for each day 
of the program, and the praise data are average percentages for 
each block of five sessions. The data shown are from students 
tutored by Kevitf^ Phases of the program are noted atop the 
figjice^—fFR 5 notations accompanying an extinction or no "program 
phase indicate that token reinforcers were scheduled during that 
phase. 

involved the No Program II - Extinction III ~ No Program III phases. 
Two students, Rick and Mark, answered more items correctly during the 
extinction phase than during either of the no program phases. Edith 
and Johnny did not show any consistent improvement during the extinction 
phase as compared to the preceding no program phase. However, the 
change from extinction (the tutoring program setting) to no program (the 



classroom setting) resulted in a clear decrement for both of these stu- 
dents. These data indicated that a higher quality of performance occurred 
In the tutOT-itf^program setting than in the classroom setting when neither 
praise nor tokerPctjnsequences were scheduled. 
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Fig, 2i Percentage correct SRA performances by the third grade 
students and percent of correct responses that were praised by 
the tutors. The percentage correct 'data are average percent- 
ages for each block of five sessions. The data shown are from 
students tutored by Curtis, Phases of the program are noted 
atop the figure, FR 5 notations accompanying an extinction or 
no program phase indicate that token reinirorcers were scheduled 
during that phase. 
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The final sequence of three phases was planned as a comparison of the 
tutoring program v/I th a token reinforcement contingency that was very 
similartb that scheduled for the other students in the third grade 
classroom. This series of manipulations involved the Reinforcement IV - 
llo Program IV (FR 5) " Reiyz for cement V phases. All students' quality 
of performance declined markedly during the token reinforcement contin- 
gency (no program phase) as compared to the tutoring program (reinforce- 
ment phases) . 



Tutor Performances 

The tutors were required to v/rite answers to each item in the ast;igned 
SRA exercises prior to leaving their classroom and beginning the tutor- 
ing sessions. This contingency was not in effect prior to the begin- 
ning (baseline) phase of the program nor during the first no program 
phase. The percentage of the assigned exercises that. were completed 
during some of the phases of the experiment"has^i>fien~ summarized in 
Table 3. 



TABL^E 3 

AVERAGE PERCENTAGE OF SRA EXERCISES COMPLETED BY TUTORS 

Phases of the Progroju 

REINFORCE- 
MENT ! . ALL SUB- 
PRE-BASELINE (SESSIONS EXTINC- MO PRO=^,^&I;nF0RCE- SEQUENT 
TUTOR (5 SESSIONS) 11-30) TIOM I GRAM 1 f-€NT III PHASES 



KEVIN 671 lOOi 100% S4% ^ 100% 100% 

CURTIS 521 ~ 96% 100% 11% 100% 100% 

nangnDnananDapppnnnaoannagonnggnnnnnnnnnannnnpHpgngnmT 



During the five sessions prior to beginning the program (pre-basel i ne) 
the tutors completed 67^ or less of their assigned exercjses j Dur ing 
No Program I they completed Jess than 85^ of the exercises. In contrast, 
beginning with the eleventh session during the first reinforcement phase 
Kevin completed 100% of the items when he was at school and when he was 
required to complete all exercises in order to leave the classroom. 
Curtis completed SS% of his exercises during the final twenty sessions 
of the first reinforcement phase and completed aJl- exercises after ses- 
sion 26 when the contingency on completing exercises was in effect. 
The contingency on completing the SRA exercises appeared to be highly 
effective in terms of the tutors completing their assigned exercises. 
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The quality of the tutors' performance is summarized in Figure 3- The 
percent correct responses each day of the program are shown. The tu- 
tors^ participation in the program {Baseline through Extinction II 
phases) resulted in an increment in the quality 'of performance up to 
session 30 for Kevin and to session k2 for Curtis regardless of the 
type of contingencies that were scheduled for the third grade students 
(i.e., baseline, reinforcement, extinction). However, discontinuing 
the program (Ih Pr'ogram I) resulted in a decrement in both tutors' per- 
formances. Returning to the program [Feinforoement III phase) resulted 
in an Immediate reappearance of the high quality performance. 
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Fig, 3, Percentage of correct ,SRA performances by 
the sixth grade students (tutors) for each day of 
the program. Phases of the program are noted atop 
the f igure. 
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Several variations in the flo Program contingencies (NP) were scheduled 
as an attempt to assess the relationship between these variations in 
NP and the quality of the tutors' performance. The first NP variation 
that was scheduled involved making free time from the classroom contin- 
gent upon the tutors* completion of the SRA assignment (NP II = FREE 
time). Curtis' performance declined in quality during NP I I as com- 
pared with the Reinforcement III phase and the Extinction III phase. 
However, the decline was not as great as observed during NP I, and the 
very slight decline in Kevin's performance may have been attributable 
to day-to-day variation rather than the effect of the NP II manipulation. 
In either case, the disruption occurring during NP \\ w^s considerably 
less than during NP I where no contingency was scheduled. 

The second variation that was scheduled involved the free time contin- 
gency scheduled in NP II and in addition providing the tutors with 
practice scoring the SRA materials. There was no detectable decrement 
in the quality of performance for either tutor relative to the preced- 
ing extinction and subsequent reinforcement phases. This suggests that 
for Curtis SRA practice in combination with the free time contingency 
was adequate to result in quality performance that was equivalent to 
the quality obtained during program phases. 



Absey.teeism 

Absenteeism was recorded daily by the third grade teacher and the sixth 
grade teacher as a matter of school policy. These records were used to 
obtain absenteeism data on the two tutors and four students for the en- 
tire school year. From these data the percentage of days when the stu- 
dents or tutors were absent was calculated by dividing Xh^ number of 
absences by the total number of school days. The percent absences are 
summarized in Table 4. u " 



TABLE k 

PERCENT ABSENCES S TOTAL DAYS 
IN EACH TYPE OF PROGRAM PHASE (IN PARENTHESES) 



Type of Program Phase 



STUDENTS 


^PRE-PROGRAM [40]^ 


^PROGRAM (95)^ 


NO'' PROGRAM 


KEVIN 


22.5 


5.3 


10 


CURTIS 


25.0 


3.; 


10 


EDITH 


J2.5 


6.3 


5 


MARK 


/5.0 


5.3 


10 


RICK 


15.0 


i.4 


0 


JOHNNY 


. 37.5 


U.9 


5 



2kk 



There were ^0 days in the pre-program phase, 95 days in the program 
phase (including reinforcement and extinction phases), and 20 days in. 
the No Program phase. During the kO days prior to the beginning of the 
baseline phase all third grade' students had a rate of absenteeism of at 
least 12.5^ or one out of every eight days. One student, Johnny, was 
absent 37-5% of that time. The tutors had absenteeism rates ,of about 
20^ to 25%. Relative to the all-school norm (average) of 5-2% and the 
school district norm of 6.U these rates were extremely high. With the 
exception of Johnny, all students* and tutors' absenteeism rates de- 
clined to near the school district norm during -the program phases* 
Johnny's absenteeism was reduced markedly from its pre-program levels. 




SESSIONS 



Fig* 4. The cumulative number of absences occur- 
ring during program sessions. The top two panels 
are the tutors^ data. The dotted line in the bot- 
tom panel indicates the average rate of absenteeism 
reported by the school district for the same school 
year. 
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A finer grain analysis of absenteeism during the program and no program 
phases can be made from Figure k. The number of absences is plotted 
cumulatively, and the dotted line in the bottom panel is the school dis- 
trict norm (average) rate of absenteeism. All rates of absenteeism were 
similar to the school district norm except Johnny's. '^Up to about the 
fiftieth 'session Johnny's rate was approximately four times the school 
district norm, and after the fiftieth session his rate was comparable 
to that norm. 



DISCUSSION ■ 

There were two criteria of effectiveness of ^the present tutoring pro- 
gram. First, the program contingencies'^onsistent ly resulted in im- 
proved performance by the third grade s tudents . That is, the combina- 
tion of praise and token consequences for correct answers resulted in 
high quality performance by the students as compared to no consequences 
(baseline and ext-jnctjon phases in Figures 1 and 2) and to programs that 
were scheduled in the classroom setting. Secondly, the tutors completed 
more of the assigned SRA exercises when their participation i*-. the tu- 
toring program v;as contingent on their completion of exercises than when 
those contingencies were not in effect (Table 3). In addition, the 
quality of the tutors* performance on the SRA exeTcises appeared to be 
functionally related to their participation as tutors (Figure 2). These 
results suggest that the program was highly effective as an instruction- 
al procedure. 

Additional manipulations of program variables were made. Fj_rst, to de- 
termine if the praise consequences contributed to the effectiveness of 
contingencies effecting the students' performance the praise consequences 
were discontinued {Extinction II in Figures 1 and 2). The removal of 
the praise resulted in a marked reduction in the quality of all students' 
performance. Pilot data from a previous variation of the present pro- 
gram indicated that praise alone was not effective in genemtim consis- 
tently high quality performance. Discontinuing praise' during the Ex- 
tinction II phase was a different procedure than the pilot procedures 
and was made to determine if the praise was involved in the mainte>ianee 
of the students' high quality performance as contrasted with the effect- 
iveness of praise to condition a similar level of performance. There 
was the possibility that praise alone was not effective during the pilot 
program since the third grade students were participating in an exten- 
sive token economy in their third grade classroom (Davis, Morris and 
Price, 1970). That is, perhaps praise consequences were not very ef- 
fective relative to token consequences that were readily available in 
the third grade classroom. 

A second set of manipulations was made to determine if the effects of 
the program were the result of simply a change in setting for the third 
grade students. That is, the students' Improved performance could have 
been maintained, in part, because of the tutoring setting and not the 
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praise or token contingencies. Comparison of data from Extinction II 
and llo Program I phases suggested that under the FR 5 token schedule 
three of four students performed at a lower level of quality in the 
classroom as compared to the tutoring setting. ^ Th^se ef fafets could 
be attributed to the delay !n presentation of ^oken conseql^ces that 
was necessary in the classroom setting. However, comparison of data 
from Extinction III phase v^ith No Program II and III phases suggested 
that the poorer performance in the classroom setting occurred indepen- 
dently of the token consequation or praise. The differences in setting 
were not simple, single variable differences. First, ^ the tutors in the 
tutoring situation Imposed some demand characteristics on the student 
to attend to the SRA materials and to respond to the items in those ma- 
terials at a fairly high rate. In the classroom the student was fairly 
free to talk to neighboring students and to dawdle. Also, an oral re- 

. sponse was required of the student in the tutoring setting, and a writ- 
ten response was required in the classroom. The contribution of these 
or other potential variables was not determined. Rather, the point is 

- that the tutoring setting alone rppeared to maintain some minimal level 
of improved performance as compared to the classroom setting. However, 
this effect may be partly a function of the students having experienced 
rany reinforced trials since baseline levels of performance were recov- 
ered during the first extinction phase for only one student, Johnny, 
and baseline levels were not recovered during subsequent extinction 
(both praise and token) phases for any of the students. 

Since a token reinforcement program had been operative for several years 
in the third grade classroom (Davis, Morris and Price, 1970), the tutor- 
ing program was seen as a special remedial program that might have been 
helpful for some students who were only minimally affected by the class- 
room token contingencies on quality performance in reading. At the end 
of the tutoring program, after a large number of reinforced responses, 
these remedial students may have been able to continue responding under 
token rei a£fiMN;ement cont i ngenci-es similar to those in effect for other 
students tn the classroom. To assess general ization^to a token economy 
the final no program phase provided FR 5 token consequences. During the 
final no program phase all students* quality of performance diminished 
noticeably under the classroom 'token contingencies as compared to the 
tutoring program contingencies {Rein f ore enent !ZV and V phases). 

In addition to the decrease in the quality of performance there was an- 
other feature of the data that was important. Concurrent with a change 
In the phase of the program, in particular from the tutoring setting to 
the classroom setting or vice versa, very sharp changes in the level of 
student performances were obtained. These sharp changes In level of 
performance were interpreted to be a form of discriminative behavior, 
and further suggested that the effects obtained with the tutoring pro- 
gram would not be obtained from (generalize to) other instructional 
settings or methods. Whether the failure of generalization of effects 



produced by the tutoring progijam was the result of extended exposure, 
the various manipulations of Jhe present project were not determined. 
There appeared to be no reasof why a progr^am fading out (thinning) the 
frequencies of token and praitse consequences and gradually fading in 
the classroom setting would not have maintained performance that was 
much higher quality than baseline performances. The use of the present 
procedures in school settings would dictate the desirability of such a 
fading procedure. 

Attempts to evaluate contingencies effecting the tutors^ quality of 
performance were equivocal. Part of indeterminate results may have 
been the result of relatively weak manipulations that were employed' 
during the no program phases. However, it was not feasible to eval- 
uate the various contingencies with the sixth grade students in their 
classroom. Therefore, all contingency changes after the first no pro- 
gram phase were made with the tutors out of their classroom which meant 
that the free time contingency was confounded with the other contingent 
cies that were scheduled^. A second feature of the manipulations that 
may have been weak was the choice of comparison conditions. That is, 
the tutoring program mai ntai ned high quality performance, and these per- 
formance levels served as the comparison or baseline levels from which 
the effects of the various no program contingencies were evaluated* 
The use of the various no program phase contingencies as comparison con- 
ditions^ or, the extension of ^^se phases another five or ten sessions 
may have resulted in different tutor data since the no program phases 
were clearly less preferred as indicated by the tutors* complaints about 
the onset of no program phases. 

The scheduling of free time from the classroom contingent upon comple- 
tion of the SRA assignments appeared to result in improved qua I i ty of 
performance (of No Progvam II - FREE TIME with No Program l) . However, 
the effects of practice with the SRA materials Were not clearly impli- 
cated by the present data. That is, the scheduling of the' free time 
contingency and SRA practice (No Program III phase) in the third grade 
classroom resulted in an improvement in Curtis* performance. But, no _ 
improvement in Kevin*s performance could be detected because of a ce^N 
ing effect during the previous no program phase. The possibility of a 
practice effect would seem reasonable since both third and sixth grade 
students were using the SRA materials, and those materials are formated 
similarly at the various skill levels and require similar types of re- 
sponses at the various skill levels. 

A rather baffling effect of the program was that the quality of the tu- 
tors* performance was susceptible to change during manipulations of con- 
tingencies that were placed on completing the exercises. Whether this 
effect (a) was specific to *the SRA exercises, (b) was representative of 
a broader interaction between improvements in the quality of performance 
and when the programmed materials increase in difficulty or skill Jevel, 
or (c) was related to some o^her unspecified variable was not determined. 



While the absenteeism data appear to be related to the students' par- 
ticipation In the tutoring program, those data cannot be said to have 
necessarily resulted from the program. Reduced absenteeism may have 
resulted from factors other than the program. The fact that Increases 
in the rate of absenteeism did not consistently occur during scheduled 
no program phases (see Table k) would support a conservative interpre- 
tation of -the absenteeism data. However, extending the duration of the 
no program phases may have resulted In consistent Increases In absen- 
teeism. 

One feature of the project that was crucial to the success of the pro- 
gram if not contributing to the improved quality of the tutors' per- 
formance- was the monitoring of the tutoring sessions. Tutoring behav- 
iors were monitored daily, and the tutors were provided with regular 
feedback concerning the<^dequaGy of their teaching responses. A less 
frequent schedule or some daily sampling procedure might be adequate 
to obtain the quality of teaching responses necessary to maintain qual- 
ity student performance; however, these possibilities do need to be ex- 



plored if the tutoring program Is to be adapted toJffbre general use. 
The present monitoring system required thart^thja twi raters each spend 
about fifteen hours per week evaluating the tape recorded tutoring ses- 
sions. By not having daily rater reliability checks that amount of 
time could be reduced, but the program should be expanded to handle a 
larger number of students which would mean more monitoring of tutors". 
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SETTiNG CmTERION RATES 
OF TEACHER PRAISE: 

THE EFFECTS 
OF VIDEO TAPE FEEDBACK 
IN A BEHAVIOR ANALYSIS 
FOLLOW THROIJGH CLASSROONlt^ 

* richard a. saudargas^ 

Two components are usually present in training teachers in behavior 
modification. The first consists of the i ntroductory material de- 
scribing the princlp^ ' of operant th<»ory, how the theory Is applied 
to the classroom, an^ either Implicit or explicit Instructions as to 
h(^w teachers should behave in the classroom. The second component, 
involves feedback to the teacher about his o.r her performance i h tile 
classroom. Research has Indicated that specific instructions do not 
lead to reliable changes in teschers* classroom behaviors (Buel, 1970; 
Gelfand, Elton and Harmon, In press; rtadsen, Becker and Thomas, 1968). 
Feedback procedures, however, have^been^fo'und to be relatively ef- 
fectiv^ln changing teachers* behaviors for at ieast'as long as the 
feedba^^ procedures are in effect (Bricker, Morgan and Grabowski, 
1970 ; fooper; Thomson and Baer, 1970; Panyon, Boozer and^rrls, 
1970 ; Cossairt, Hall and Hopkins,. 197?; Thojnas, 1972). 

One problem with giving teachei^s classroom feedback concerns how the 
feedbacLJs transmitted. In one study , -feedbacfiT^as given by the 
.classrx>om observers (Cooper et^al., 1971) • In a second study, Thomas 
(1972) used videotape recordings to provide teachers with feedback. 
Neither^T these studies reported datavhich i nd!.ca.ted-zWhet4^er teach- 
ers beKayed appropriately in the absence'"of tb*^ observejs or the vid-*" 
eotape recorders. _ . ^ 
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The present study analyzed the effect of videotape feedback on estab- 
lishing criterion rates of teacher praise. In order to determine the 
discriminative effects of the presence of the videotape recorder, add- 
itional data were' obtai ned by observers when the videotape recorders 
were not in operation. — 

METHOD 

Setting ; — 

The^ptudy was conducted in one first grade and one third grade class 
in Philadelphia^ Pennsylvania'. Children who attended the training 
center were area residents. * , 



Thf classroom day was divided into a series of a-lternating "earn per- 
iods/*'_and *'spenff periods During each 30-minute eara-period children 
earned tokens for working in one -of four assigned academic areas: 
reading, handwriting and spelling, mathematics^ and language arts. 
The children rotated through each academic area at least once a day 
and eacK child was allowed to work at his own pace. .Each earn period 
was "foi^l owed by a 20-minute spend period du/i-ng which children ex- 
changed tokens for games and other reinforcing actLvities. 

Tedehers ' ~ 

One first grade teacher aide and one third grade teacher aide who 
taught handwriting and spelling served as subjects. Both aides were 
mothers of'children in the Behavior Analysis Follow Through program. 

Daily Data Collection Procedures 

VIDEOTAPE RECORDING. During the^irst morning earn period, each te-»ch' 
er was videotaped for ten m^inutes. Q^bservers rated the videotapes .n 
the afternoon. • . ^ 

OBSERVER RECORDING. Teacher A was observed for se^en minutes during 
each 'of the three morning earn periods when the videotape recorder'was 
not in operation. Teacher B was observed during the first two morning 
^earn periods. Observer recorded between the 10th and ZOtli" mi nute of 
each earn period. Apprdxinat<»ly one hour separated^ each -observation. 

f^NITORING TEACHER PRAISE RATES (Academic Apprpvals). Acaaemic Appro- 
vals were defined as praise statements made by the teacher to a spec- 
ific child contingent upon correct student academic behavior. Behav- 
iors such as raised hands and sitting quietly were- not considered aca- 
demic becaufe the child could emit them in the absence of any books. 
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Three parents of community children were trained to record the occur- 
rence of Academic Approvals. Observations of teacher-child interac- 
tions were continuously recorded In discrete one minute t\r/i intervals. 
Two types of reliability were calculated. Occurrence reliability was 
calculated between two observers^and determined the extent to which 
the observers recorded the-Academlc Approvals at the same time. Occur- 
rence reliability was obtained by dividing the number of agreements 
by the number of agreements plus disagreements between the observers 
(Thomas' Becker and Armstrong, I968): At least two reliability checks 
were made during each of the conditions for observer recorded data. 
Occurrence reliability for Teacher A varied between .76 and 1.00 with 
a mean of .86. The mean occurrence reliability for Teacher B was .87 
and ranged between .71 and 1.00. Frequency rel iabi 1 1 ty was calculated 
between the teachers* frequency counts and the observers^ frequency 
counts taken from the videotape recordings. Frequency rel i abi 1 i ty was 
obtained by dividing the lower frequency by the higher frequency »f or 
the ten minute videotape recording. Frequency reliability was calcu- 
lated daily when the teachers counted Academic Approvals. Mean- fre- 
quency reliability for Teacher A'was .88 (range = .81 - l.OO) and for 
Teacher B, .87 (range = .76 - .96). 

Experimental Conditions 

BASELINE. No manipulations of teacher behavior v;^ re attempted during 
the baseline conditions. The teachers were monitored by both video- 
tape recorders and observers.^ - 

COUNT + GRAPH + CRITERION RATE OF ^ACADEMIC APPROVALS. ' Each teacher was 
asked to meet a speci f ied^_cri terion rate pf Academic Approvals. On a 
graph posted near the teacher's instructional area, a line was drawn 
so that the teacher could see whether or not the criterion had been met. 
Two different criteria were set. One criterion was set at 5.0 Academic 
Approvals per minute. The second was established at 2.0 Academic Ap- 
provals per mi nute. 

Each'jteacher was trained separately to count and graph Acjdemlc^Approv- 
als rates from her own videotape recordings on the first day of the 
first experimental condition. No additional assistance was given to 
the teachers after the first day of training. Teacher ratings of the 
videotape recordings were^made each day in the afternoon about four 
hours after the videotapes were made. After calculating her rate, she 
plotted it on her classroom graph. 

During the last session of each experimental condition, the teachers 
were told that they would no longer be requiretl to observe their video- 
tape recordings and that there were no restrictions on rates of Academ- 
ic Approval", 
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Each criterion rate condition was run until the teacher^s rate met or 
exceeded criterion for at least two consecutive observation day5_for 
theobserver recorded data of Earn Period' I, Baseline conditions 
were changed when the baseline rate was not within the criterion range 
for at least two consecutive observation days for the observer recorded 
data. of Earn Period L 

RESEARCH DESIGN. A reversal desrgn was used with the- experimental con- 
ditions sequences in opposite order for the two teachers. 

The research design for Teacher A was as follows: 
^Baseline 1 

%Coun1f Graph -f 6,0 per minute criterion 
% Baseline 2 . 

%Count -f Graph -h 2\0 per minute criterion ' " 

%Count -h -Graph -f 6,0 per minute criterion 

%Count -f Graph f 2,0 per minute criterion / 



The research design for Teacher B was as follows: 

if 

^Baseline 1 

%Count -f Graph -f 2,0 per minute criterion 
^Baseline 2 

%Count -f Graph -h 6,0 per minute criterion 

^Count -f Graph -f 2.0 per minute criterion 

%Count -f Graph -h 6,0 per minute criterion 

RESULTS 

Rates per minute were graphed for' each teacher and median -Hnes^-'were 
drawn through the data points for each experimental condition* 

Teacher A (Figure 1) ^ ' - 

* 

The rate data for Baseline I were stable during the observed time per- 
iods. The medians ranged from 2.6 to 3.2 Academic Approvals •per min- 
ute. Viftien the criterion was ^et at 5.0 Academic Approvals per minute, 
daily trends i^n'the direction of the criterion were observed during all 
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time periods. The median rate for the Videotape Monitored data was 
above the criterion, — 
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Fig. I. - Teacher A rates of Academic Approvals 
for each^observatron^DBrroar 

During Baseline 2 the rates were higher than Baseline 1 in all obser-* 
vation periods. Rates during Earn Period l.^and^Earn Period II appeared 
to decline more than the Vjdeotape Monitored and Earn Period II data. 
When the criterion was shifted to 2;0-per minute, the rate of Academic 
Approvals decreased toward the criterion value in all observation time 
periods. 

When the criterion was returned to 5.0 per minute, the observer re- 
corded data of Earn Period I showed an almost daily increase toward 
the criterion rate. The Videotape Monitored data showed an upward trend 
only for the last two days of the condition. There did not appear to 
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be any differences in rate from the previous 2,0 criterion condition 
during Earn Period II and Earn Period ML * 

During the second 2.0 condition, the rate of Academic Approvals for the 
Videotape Monitored time period decreased to cri ter Ion and srtabi Vi zed 
around.^. 0 .per minute. The observer monitored data of Earn Period I de- 
creased to a rate slightly below the criterion rate. It was difficult 
to discern any rate changes for the observer data recorded during Earn 
Period II and Earn Period III. 



Teacher B (Figure 2) 

The median rates for Baseline 1 varied within 1.0 Academic Approvals 
per minute between observation times, but there were two noticeable 
trends in the data. One trend appeared on day 7 during the Videotape 
Monitored condition when rate Increased sharply. The data then de- 
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creased steadXly until the end of the baseline condition. The data 
for Earn Period I did not appear to follow the trend, of the Videotape 
Moni tored- data. However, during Earn Peri.od II an apparently decreas- 
ing baseline reversed after day 5 and inc ased steadily until day 9. 

During the first criterion condition (2.0 Academic Approvals per min- 
ute), the rates for the Videotape Monitored data and Observer Monitored 
data for Earn Period I moved toward the criterion rate. There was an 
overall decrease in rate of Academic Approvals during Earn Period II* 

During Baseline 2, rates rFe'mai ned relatively low and stable during all 
observation time periods. 

When the criterion was changed to 5.0 Academic Approvals per minute, 
the rates of Earn Period I and Earn Period II increased from the Base- 
line 2 to the cri terion; rate. There was a median increase from Base-, 
line 2 for the Videotape Moni torli^observati ons but no general tendency 
to meet the criterion rate. 

As in the previous criterion 2.0 condition, both the Videotape Monitored 
observations and the data recorded during Earn Period I fo]](y^ed the 
same general trend in the direction of the criterion rate. The rates 
of Earn Period II were highly variable. 

Upon returning to a criterion rate of 5.0 Academig^ Approvals per min- 
ute, an increase in observed rates appeared evident for the three ob- 
servation time periods. Only the data recorded for Earn Period I met 
the minimum stability criterion. 



DISCUSSION 

The dsta indicated that^having teachers count, graph, and attempt to 
meet two different criterion rates of Academic Approvals effectively"^^ 
increased and decreased teacher rates. The data further indicated that 
the criterion rate changes were produced most reliably during the time 
period the teachers v/ere being videotaped and during the observation 
time period immediately foMowing the videotape recording. The results 
recorded for Earn Periods later in the morning v/ere not consistent with- 
tin or between teachers* In general, the effect of setting criterion 
Jrates was Jess evident during Earn Periods II and III (Teacher A), and 
"iarn Period II ^Teacher B), especially during the last two experimental 
conditions. 

The"day to day tendency for the rates to move in the direction of the 
criterion rate^was relatively consistent between teachers. One teacher 
commented, however, that pacing her prais'e during the crrterjon condi- 
tions was difficult to do. The comment by the teacher suggests a tim- 
ing Vijhich had to be learned each time the criterion rate was .changed. 
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A second purpose of the present experiirient was to determine if teachers 
would discriminate the feedback transmi tter. . If there was a discrim- 
inative effect, the teachers would have behaved differentially in the 
presence o\ the videotape recorder and the observers. The results of 
this study suggest little if any discrimination between the videotape 
monitoring and the observer recording during Earn Period I. The 
chani^s In rate brought about by changing the criterion requirements 
were observed by both the videotape recorders and the observers. 

the teachers were observed to have emitted Academfc-^pprovals at the 
rate of the criterion condition prior to Baseline' 2. The median rate 
of Teacher A during Baseline 1 was 3.0 Academic Approvals per minute. 
When she^ had experienced meeting a criterion rate of 5.0, the rate of 
Baseline 2 was k.6 per minute. For Teacher B the Baseline 1 rate cf 
Academic Approvals was 4.8 per minute. The median rate for Baseline 2 
after experience meeting a criterion rate of 2.0 per minute was 2.1 
Academic Approvals per minute. These results suggest that the teachers* 
behavior came under the control of reinforcing stimuli other than the 
videotape feedback. Future research shoul^d be done to replicate and 
clarify these fvindings. ; 

f ^ \ ^ • 

Jn the presentfexperiment the videotape recordings were observed each i , . 
day the crirerfon fonditions were in effect. One question raisedjrbv.^l.M ^ 
others (e.g.MnTornas , 1972) is concerned with the feedback sched'uleT 
which would maintain a desired rate of teacher beiavior. An extensVon 
of the present experiment would be to vary the schedule with which ftfe-t^^ 
teachers receive feedback. K 

One aspect of generality is concerned with applying a variable to dif- 
ferent behaviors (Sidman, I960). The present techniques could easily 
be applied^.to other teacher behaviors such as questioning, disapprov- 
ing, and long chains of teaching behavior. If it could be shown that 
these techniques could also be used to change behaviors other than ' " 
praise, ^_greater degree of generality would.be demonstrated. 

It might not be necessary to use videotape feedback if other mechanisms 
could be found such as trained observers or supervisors. However, 
other research which has used observers and supervisors as feedback 
transmitters has been equivocal (Cossairt et al., 1972; Thomson, 
Holmberg and Baer, 1972). None of the previous research on feedback to 
teachers has set criterion rates. Setting a criterion may be critical 
for consistent changes in teacher behaviors. 
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Schedules of follow-up and 
their effect upon the maintenance of 
a prescriptive teaching program 

beverley holden 
betk sulzer-azaroff 



INTRODUCTION 

fhe purpose of this study was to determine how a special class teacher 
could conduct an effective and efficient foUow-up program with stu- 
dents placed back In regular classrooms. The relationships between 
two different schedules with whfoh the special teacher contacted the 
•regular classroom-teacher were compared to assess their effect upon 
the students* subsequent performance. 

METHOD 

Subgects 

The subjects in this study v^ere five children and their regular class 
teachers. The children were enrolled in the Pupil Assessment Class at 
Southern Illinois University for a period of at least five weeks. All 
were first graders. The children had been referred to this class be- 
cause of various learning problems In the areas of visual discrimina- 
tion and spatial organization* The special classroom teacher (E) was 
in charge of the academic program. The regular classroom teachers were 
those who had taught the child both prior to his entrance in the^^^ipec- 
ial program and upon his departure from it* 

t 

Experimental Space , Apparatus and l-Jatevials 

The children were enrolled in the Assessment Class program before re- 
turning to their regular classroom. The class was equipped with fur- 
nishings similar to those found in a typical public school. At leasl_^ 
two hours of the day in the -room were spent in group Instruction of 
reading, arithnietic and language. The other two hours were Sf5eht-ln 
individual activities designed to determine the children's difficulties 
and how to 'remediate them* 

* - . <■ 

Specific act^Lvitjes used by^ the subjects included a series of visual-^ 
discrimination ex erci ses^Task .1) : Marianne Frostig Sheets, Scott Fores- 
man Open Highways sheets, and exercises from the Continental Press. 



The Fitzhugh Spatial Organization Series — 101, 102^ and 104 (1968) 
constituted Task II. Both tasks consisted of pages containing either 
four or six individual frames in which, the requirement was to note sim- 
ilarities and differences by circling appropriate items. Responses 
were defined as right or wrong. ^ 

Reliability * 

Rel iabi 1 i ty'^of scoring presented no problem since there was^a permanent 
record in the form of the student •s v;orksheets Worksheets were com- 
pared with the teacher* s data sheets. In every case there was 100% 
agreement. 

Procedure " 

When the children returned to the regular classroom they took a pre- 
scriptive^^eaching program with them. This included lesson ideas in 
the weak '/areas and worksheets as described, above for remediation. The 
regular teacher was asked to write the student's name and the date at 
the top of each paper the child completed. She was also given^a sheet 
to fill out each day. On It she marked the exercises the child did and 
the number of correct responses. A folder was provided for storing the 
student^s work. She was asked to save the sheets so that: the E could 
col lect them at the end of the project. 

The telephone was used as the means, for follov-^-up. Two phone call, sched- 
ules were used to control for order effects* Order 1 consisted first of 
a baseline. During this time the teacher was not called until the last 
day- of the two-week period. Next, there wa& an Fl 5 schedule, during 
which the teacher was called every fifth school day for two weeks. 'The 
next phase was an Fl I, during which the teacher was called every school 
day for two weeks. The next step was a return to Fl 5 for two weeks, 
then a return to Fl I for the same amount of time* Order 1 1. consisted 
of the reverse, of the above. .First, was the two week baseline, next the 
Fl I schedule, then the FT 5 schedule^ for two weeks, then a rpturn -to the 
Fl 1 , -and finally to the Fl 5 schedule again. (See Table K ) 

When the special class teacher called the regular class teacher she only 
asked about one of the two assigned tasks. This was done to determine if 
Inquiring al^out one task only would produce a di f ferentl^tHsf feet upor. 
performance on eacK of tfie two tasks (i.e., would'^'i nqui r i ng aboutf Task I 
profJuce a relatively higher rate of performance on that task and vice ver- 
sa). Usually the special teacher would ask how things were in general in 
the classroom and then would say that, she wanted to find out how-the chi 
was doing with one task. If the regular teacher* m^e mention of the other" 
task the special' teacher- would usually change the Reject and return to 
the one selected for inquiry. She v^ould^also give the teacher verbal re- 
inforcement when appropriate, by making some comment such as, '*Mm certain- 
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TABLE 1 



SUBJECT 



F0LL0W-4iP PROCEDURE 



TASKS 
ASSIGNED 



TASK 

INQUIRED ABOUT 



ORDER OF PHONE 
CALL SCHEDULES 
CHANGED EVERY 
TWO WEEKS 



1 


FITZHUGH & VISUAL 


VISUAL DllpRIM- 


BASELINE 


Fl 


5, 






DISCRIMINATION 


1 NAT ION 


Fl 1, Fl 


5, 


Fl 


1 


2 


FITZHUGH & VISUAL 


1 TZHUGH 


BASELINE 


Fl 


5, 






DISCRIMINATION 




FIJ , Fl 


5, 


Fl 


"l 


3 


fitzhugh"'& visual 


VJSUAL DISCRIM- 


BASELINE 




1, 






DISCRIMINATION 


I^^ON 


Fl 5, Fl 




FL 


5 


4 


FITZHUGH & VISUAL 


F 1 TZHUGH 


BASELINE 


Fl 


1, 






DISCRIMINATION 




Fl 5, Fl 


1, 


Fl 


5 


5 


FITZHUGH i VISUAL 


VISUAL DISCRIf^- 


BASELINE 


Fl 


5, 






OISCRIMINATI-CK- 


i NAT ION 


Fl 1,-FJ 


5, 


Fl 


1 



1y glad that you are willing to lleep \n contact with me and are helping 
with (child's) work."^ ^ ^ - ^ 

After the cal l^g*i^fa"ses of the program were completed, the E collected 
the student's work folder by maki?^ a visit to the school and continued 
to keep in contact at least once a month^or the remainder of the school 
year, - 



RESULTS 

For summary purposes the combined results of Stibjects 1 through 4 are 
shown in Figures 1 and 2. Subject 5's results were nol included since 
very little data were obtained on that 5. 

The total number correct and completed in both the E*-inquired and unin- 
quired tasks are shown in Figures 1 and 2. These show comparatively 
higher rates of performance when phone calls were made each day rather 
than once a week. Thus, the more phone calls the more work the child 
accomplished. 
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Fig. I. Cumulative number of correct and completed 
resDonses for four subjects on the visual discrin- 
indtion task. 

In the visual discrimination task, Initial ly there was a higher perform- 
ance rate on the uninqulred task than the Inquired one 'but as time pro- 
gressed the rate for the Inquired work Increased to a much higher pro- 
portion, particularly In the last two weeks of the study. With the Fltz- 
hugh task the rate on the E-Inqulred task was higher In four of the 
phases than when It was not Inquired about. 

Both the cumulative number completed and the number correct were tabu- 
lated for each S, under each feedback condition. Results for each 5's 
performance on each task are shown in Figures 3 through 11. Figures 3 
and k show the work of Subject 1 for whom the ^-Inquired task was the 
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Fip 2. Cumulative number of correct and compJeted 
re<.ponses for four subjects on the Fitzhugh task. 



ERIC 



visual discrimination one. During baseline the teacher had the child 
do the work every day except the last. In the Fl 5 phase the cumulative 
performance dropped slightly. In the third phase (Fl 1) the cumulative 
rate of responses rose subtantially from the prior phase. When weekly 
calls resumed, the rate dropped to 120 from 1?^ correct during the pre- 
vious phase. When phone calls were again increased to one each day, the 
rate rose for the number completed in the E-inquired task but dropped 
slightly for number correct. 

E did not inquire about the Fitzhugh task for the subject shown in Fig- 
ures 3 and k. However, the classroom teacher still did the work with 
the child. The rate dropped slightly during the Fl 5 phase and then 
rose in the Fl 1 phase. The rate dropped when phone calls were again 
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Fig. 4. Subject I , F t tzhugh Task. 
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only made once '^a week* Another increase was seen when phone calls.wSre 
again made every day^. The number completed rose from 46 to 87 while 
the nufriber correct rose from 28 to 46v 

Comparing the_t^asks, there was a higher rate of work for the E-inquired 
task than for the other (Fitzhugh). The difference is most apparent in 
the second Fl 5 schedule. 



I 

I 

I 

J 



3 

-4 



Figures 5 and 6 show the perfor manc e, of Subject 2 for whom tno E-inquired 
task was the^Fi tzhugh. Durirrgrbasel i ne, 108 FitzhugK items were com- 
pleted, 88 of th*em co-rect. In the Fl^5 phase? the cumulative number 
correct dropped but t:.a number completed stayed the same. When calls 
were made each day the rate rose but only four:..paints. for the^number com- 
pleted and eight points for the number correct. Wi4Ji calls again occur- 
ring only once a week, the number completed dropped from 112 to 47 and 
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Fig. 5. Subject 2, Fitzhugh Task. 
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Fig. L. Subject-2, Visual Di scrimi nation Task. 

the number correct dropped from 86 to tk. With the return to Fl 1 the 
rates for number correct and completed rose. 

In the uninquired visual discrimination t-aslctJie baseline rate for nurAer 
correct and completed was 112% During the neWt phase (Fl 5) the number 
correct and completed rose slightly. With phone calls made each day the - 
number correct and complete continued to rise. When phone xajjsjwe re ^ ^ 
made only weekly during the second Fl 5 phase , there was a drastic drop 
in both the number correct and completed. When the teacher was again 
called each day, the cumulative rate nurnber completed rose but -the number 
correct did not. 




Fig. 7. Subject 3, Visual Di scrimi na*-ion Task* 



The results of the .work of Subject 3 are recorded on Figures 7 and 8. - 
The baseline for the visual djscrimination task (E-inquired) was very 
lo»//. The 5 did. very-few sheets of work' during this time. During the 
Fl 1 phase there was a substantial increaseMn the amoTint or work ihe ^ 
child di.d in this task. The number completed rose to 79; the -number - 
correct 70. During the next phase (Fl 5) 'the rate of work both completed 
and correct rose. I:, continued to rise during the reinstatement of the 
Fl 1 phase and reached its highest rate when telephone calls were made 
only once a week. Ti)us, there was a steady increase in work comp.eted 
and correct in the visual discriminationjtasfeduring the progress of the 
project. - ' ' * ^ ^ 

In the Fitzhugh task, the uninquired ohcT£.did more of the work during 
the baseJine than during the following three phases. When the Fl 1 was 
Instated^ the work completed and correct droppW^from"62 to-27.* during. 
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Fig. 8. Subject 3, Fitzh ugh Task. _ ^ 

the Fl 5 phas^the^amount of work rose but ohiy 8 points. When dally 
phone calls were again reinstituted the rate of work completed and cor- 
rect dropped 7 and 5 j>oints respect iveryrHA^ain, with weekly calls the ' 
rate ro?e to its maximum level. - ^ ' 

Comparing perfi>tmance on tv'o tasks, one sees that the rate. for the 
■E-inquired task rose consistently throughout the project. The rate for 
the un^nquired one, however, dropped after baseline and only rose again 
in the last phase. - ^ 

Figures 9 and 10 show the results of Subject 4^8 performance. For the 
Fitzhugh task, the ^-inquired one, during baseline t^ number completed 
and correct was 168 and 159 respectively, the highes. rates in this task 
during the entire project.. The, rate decreased-^en^concact was made with 
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the teacher each day but it was higher than it was during the subsequent 
phase (F1\5) . The rate therf ihcrea^elf^ifoticeablhy^when caTls^^were^fiacle 
^ach day again* During the last Fl 5"the rate decreased to 0 for all 
^ten days. The rate of work was higher in both Fl 1 phases than in Fl 5. 

Baseline performance In the visual di scrimtnatlon task (unl nqui red) . was 
89 composted and 77 correct. When daily phone call inquiries were made 
about the other task».the number completed rose to ]k6 while the number 
correct ros"e to~123. When phone calls were made only once a week both 
the rate completed and correct dropped; almost 50 fewer items were com- 
p1eted« When the dai ly schedule was again JnstI tuted the ra^tes rose to 
their highest level ^and when the wee'kly phone calls wore resumed, the 
rate dropped almost 100 points in both number completed and number cor- 
rect. 




umm pu ] ?|i ^ fit •^|ytiiii . 

• Fig.. 9. Subject 4, Fitzhugh Task. 

Thus, the rate In both tasks was higher in the Fl t phases thah In the 
Fl 5 phases. The most notable difference In the Fitzhugh task was be- 
tween the Fl V phase. and the Fl 5 when the work dropped to p. 
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Fig* 10* Subject 4, Visual 0: scrlmination* Task. 



The only recorded data for Subject 5 are shown on the following page in 
Figure 11. Telephone calls^were ended abruptly on the third day of the 
Fl I phase* When E-mp3e"The phone call, the classroom teacher asked her 
not to call anymore because it was too much bother for the- secretary to 
come to get her and^ for her to come to the phor^e*. E then went to col- 
lect The completed worksheets. Suboeet S*e teacher had .failed to fill 
out the data sheets but did place dates onthe visual discrimination 
sheets, the Fitzhugh work was not dated, although about 300 responses' 
with the child had been completed. Subgeat S worked on the" visual dis- 
crimination task on Days 1 , 2, and 5 during the baseline and no further 
work was done. . * ' ' = 
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Fig. II-. Subject 5, Visua.1 Discrimination Task, 



DISCUSSION 

The data suggest that telephone contact can be an effective follow-up 
technique for maintaining a classroom teacher's compliance with a pre- 
scriptive teaching program. .Four of thejteachers in this study :arried 
out the prescriptive program at a fairly high rate. The .teache* fcon- 
tinued -to-see that both tasks were carried tfut whether the parTtTDTlaH 
task vyas Inquired about or not. ' ^ 

Daily phone calls were more effective: for three of the subjects (2^ 2/ 
'and 4)/ However, whether thr-difference was striking enough to warrant 
the time and bother of such a high frequency of ghone, calls is question- 
able. It appeared that some teachers (as well as the E) became tired of 
the daily calls. This was particularly true in the case of Subject 5 
_f.or whom the piuanfi^calls wer:£iapparently averslve. 



The brief two-week baseline phases were Insufficient to determine whether 
compliance with the prescription would hav*^ maintained over prolonged 
periods of ti|Be, 4^ith no periodic contact from the E. However, tf.e tend- 
ency towards hi'gher student performance^ rates iji^ conjunct ion with deliser 
frequencie^f contact suggest that- such contacts are at least somewhat 
^functionally related to compliance with the prescriptive teaching pro- 
gram*^ . . . . - . • 

A related study (Hunt and Sulzer-Azarof f^ 1972) is currenlly-beitig under- 
taken with a group of parents of pretrainab^e retardateT. In the ongoing 
sftjdy, two^ groups. of pareftts] are the subjects. 'The first group, of four 
pareflts was contacted regularly since the da/ immediately following their 
receipt of -the prescription. The second group was not contacted for sev- 
eral weeks. Four-1of four parents Jn the first group continued to comply 
with the grescription for four wec*s,^hile only one of ^the four in the 
second group did so duri ng- the four-week perl.od when they were ignored.,- 
It may, therefore, be safe to. assume that rates of compliance %y teachers 
in the^present study, wduld have graduaH^rtftmi nish*ed over t ime - and't h g t" 
continued contact by~ phone, helped to maintain theTr rates of responding. 

Here research needs to be completed to examine effectiveness of other 
schedules of teacher contact, -for example, once a month or bi-monthly. 
The use of a control group would help to determine a more precise eval- - 
uation of the impact of. the follow-up prograj}. 
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A COMPARISON OF ^ 
THREE DIFFERENT TYPES OFMEEDBACK 
W TEACHERS' PERFORMANCE 

santh rule 

Three teaching behavforsr-^i\>is6^ on-J!^kSf^eontacts 
and of f ^task contaotS'^\^ere^ modified In^ne sub^ 
jects* A. mult^le baseline dei^ign was employed to 
test the effects of^hr|ie:frocedures: instructions _ 
and experimenter feedbacft,-' videotape -scori ng of 
one's own behaVior., and a direct intervention pro- *^ 
cedure*^ which the exD^rimenter temporarily re- 
placed- <f he subject whiipfe teaching behavior fell 
Below criterion, * . ^ 

Direct Intervention was most effective in changing' 
±S^±^rs'^ behavior. Smaller changes in the sub-'j 



— ^^k' rates of praise, on-task contacts, and off 
task contacts occurrfed-xKiHng the video scoring 
procedure^ and no predictable change occurred in - 
the instructions plus feedback condition. 

It has been consistentJy reported that- teachers ' behaviors a£fect chil- 
dren's behaviors. In particular; behaviors to which teachers attend, 
generally increase and behaviors which they ignore decrease. A combin- 
atton of positive reinforcement arid^extinction or punishment has been 
effective in chang4rfg ch|Hdren's behaviors (Broden^ Michell, Carter 
and Hall, 1970; Hall, Lund and Jackspn, 1968f McAll ister^- Stachowiak, 
Baer and Conderman, I969; Madsen, _Becker and Thomas, I968; Packard, 
1970; Schutte and^Hopkins, 1970: Thomas, Becker and Armstrong, I968; 
Wasik, Senn, Welch and Codper7^l969) . * , ^'^ 

^ecause teachers', behaviors affect children's behaviors, it is impor- 
^'tant to know-how to teach teachers to behave effectively. Three meth- 
ods have been reported irbrthe 1 ite«|i4ite cojicerning behavior modifica- 
tion. First, instructions, -pfobably^the'most frequently required meth- 
od of teacher training (nearly all states require teachers to take 
•methods" courses ij) which they are tolckhcw to teach) havejbegn re- 
.ported to have 1 i ttl'e effect on changi ng^eacher bebaTi or (Madsen, ' 
Becker and Thomas^ 1968). Second , -feedback to teachers about their 
own behavior has beea denials t rated to be effective in-cha*igin^^ihei r 
behaviors (Cooper, Thtimsorftand Baer, 1970). Th|rd,>videptape scoring, 
in which teachers score tapes of themselves teaching, has als^ been re- 
ported to be effectfW in modifying the behavio'r'of teachers (Thomas 
1972). - * 1 ^ * 

■ ■ ■ • • ¥ \ ■ ■ 
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There Is ^however, no consensus as ,to the^ relative effectTveness of 
'arTfeTernrtrarrrlqg' techn and the effects of^ any procedure' are 

not always predictable. Bailey arid. Wehr (1971)> for example, reported 
no change In two teacher behaviors when the teacher viewed videotapes 
of'herself teaching and received gr^aphic^ feedback as to the rates of 
those behaviors. Since few compari sons' of "teScher 'trai ning techni^ques 
have been published in the literature of bjehgvlor modi f icatiqn,. i t is 
difficult to say which procedures migFt be most effectivexin teacher * 
Jtraining programs. - . - ' ^ \\ 

""This study examined the effects of three di f fererrt^echm^^ for mod- ' 
ifying teachers* behavior:^ i nstruct ions- plus feedback from th% exper- 
imenter, video-feedback, and a direct intervention procedure- Three 
behaviors, praise, o n- 1 as k co n t a c t s— arid-o f 1 ask contacts, were studied 
because these behaviors have3een reported to affect such^student be^ 
haviors as s'tudyingf foHowing Iris tructi^bns* and engagi^n appropriate- 
sociaj behaviors in class (Hair, Lund and Jackson,^1968;; M ad^ Becker 
apd Thomas, l968nSchutte and Hopkins, .1970; Thomas, Becker -and T~ 
Armstrong, 1968}.^ f 

^ ' * I * 

* ., 

The nine subjects ranged In age fro.Ti 19 to 29 years. Two trainees had 
one and five years^ teaching experience respectively. The other seven 
subjects had not taught before.^ One had read sj)me^ behayior modifica- 
tion literature. Five subjects participated ifi aU^hases of the study; 
fourwere^only available for abbreviated training sequences. 

All trainees were volunteers who taught' math In one or both of two math 
classes at the-Colorado SprI ngs Communl ty School, an elementary /r^^ 
school with an enrollment of ^0 students. Each class was one ^hour. long > 
The first class had 18 students ranging In age from 9 to l4. The 12 ' 
children In the other class led In age from 5 to 9- The children 
worked on IndKvi dual Ized it ( Is adapted from Sets^ ayid Numbers^ books K 
through 6 (Suppes, 1962). 

the teachers were- told that they were participants in a study of the ef- 
fects of different types of feedback on teacher behavior. The experi- 
menter said she would discuss some procedures with the teachers -!at a 
later time.** . 



Design * 

The stud^fwas a multiple baseline design,- both across subjects and. across 
behavl.oiis^wiithin Subjects. Each training procedure (Iristructlons , vid- 
eotape and direct Intervention) was applied to alter the rate of three 
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teacher behaviors: praise, on-task contacts and off-task contacts. 
Two behaviors were manipulated In each subject during each condition, 
while the other behavior was allowed to vary/ Experimental conditions 
began at different times for different subjects. * 

Vefinitiom and Reliability . — - 

A contact was defined as any verbal statement (other than praise) di- 
rected to one child* A contact lasted until the teacher moved to an- 
fOther child or untfl Ine child spoke. Each contact was scored on-task 
i.f directed to a-chlld who was work jng or -rai sinj^his hand to request 
teacher attention, and-^f-task if directed to a child doing anything 
else. Praise was defined as any remark such as **that 's good,*' ''that's 
rightl' or "1 .like the v^ay you are working.** 

Videotape recordings were made of each session and scored by the exper 
imeriter and an independent observer. Both observers scored each ses- 
sion for the first three weeks. Thereafterv the independent observer 
scored aperiodlcal ly for an ayerageof one out of every five sessions. 

The following precautions were takea to avo*d expeTimenter bias In the 
scoring and to minimize the effect of such var Tab les as the time of 
the period during which the*behavior was sampled. If several subjects 
were' teaching simultaneously-, they were videotaped in a different orde 
each day. If a subject was videotaped for more than five minutes, a 
recording sample was selected by running-the tape on a fast forward 
speed, (so that no pre-viewing was possibj^e)^ stpppTng the tape after 
some unspecified time, and recording for five minutes. ' The^ indepen- 
dent observer was not informed as ?o which experimental' procedure was 
in effect. . " w--^^ 

A frequency count of praise, on-task contacts and off-tas^< contacts 
(see definitions below) was made by behavioral rather than terfiporal 
interval-. An interval began with the teacher's Initial contactto a 
particular child and ended when she spoke-to'^r^'f feVent child.-^ 

The total nuni^er of agreements in interval was the total number of 
occurrences of each of the three behaviors which was^ seen by both ob- 
servers. Disagreements were scored each time one observer scored a 
behavior not scored by the other observer. 

Inter-observer reliability (agreements divided by agreements plus dis"- 
agreements times 100) on videotapes^ was 3X%jmJ:h 'a range^ f roip 82% to 
100%. Calculated in the same manner, agreement between the experimen- 
ter's live scoring and scoring of videotapes ranged from 83% to 90% 
wlth^a mean of 87%* Agreement between-^the- experimenter and all train- 
ees during the video feedback condition averaged 82% w'th a range of 
71% to 100%. . . , • 
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Stability Criteria 

Following baseline, the experimental conditions were applied^'to each 
target behavior until the subject's rate of that behavior, met two con- 
ditions: it showed no trend toward the criterion for three days, and 
its, rate was within 20% of the mean of the previous three days (for 
behaviors whose rates were 20 responses per minute or higher) or with- 
in five responses per minute of the mean (for behaviors whose rates 
were less than 20 responses per minute). The experimental procedures 
were applied to the second behavior when the first met the criteria 
for stability. Because the stability criterion was applied only to 
the current target behavior, experimental condi t ions" were occasionally 
'changed at a time when the criterion no longer applied to the first 
target behavior. For example, instructions concernirfg rate of of f- 
task contacts were given to Subject I before session 6. That behavior 
met the cri terionj for stability after session 1 1 > so instructions con- 
cerning his rate^bf praise were given before session '12. His praise 
rate met the criterion for stability after session 17, so a new ex- 
perimental condition began on session^ 18 with respect to off-task con- 
tacts, even though a downward trend occurred for that behavior during 
sessions 15, 16 and 17. 

BASELINE . On the first day~ in the classroom, each trainee was in-., 
structed to ^*take over the math group'* of three to five children. The 
trainee was. told only that the children were allowed to ask questions 
about : :ontent of the worksheets (e.g., they could ask the meaning 
of symbolb or how to work particular types of problems). No further 
instructions were given. Baseline conditions were maintained until 
observational records indicated that the subject's rates of contact 
and praise were stable. The trai nee. received no feedback from the 
experimenter during this condition. 

INSTRUCTIONS AND EXPERIMENTER FEEDBACK . During this condi tien each 
subject was given a definition and criterion for the behavior the ex- 
perimenter was attempting to alter. For example, if the rate of off- 
task contacts was too high, the trainee was told that it was appropri- 
ate to attend only to' children who were working or raising their hand 
to request teacher attention. He was told not to attend to anyone who 
was not engaging in these behaviors. Consequently , the criterion rate 
for contacts to on-task children was four per minute, and the criterion 
rate , for "statements of praise (contingent on working well or answering 
correctly), was two per minute. 

Throughout this condition graphs of the trainee^s defined behaviors 
were posted in the room, and the ordinate arid the abscissa were ex- 
plained to the trainee. Definitions and criteria for target behaviors 
were repeated to the subject daily. Manipulation of a second behav- 
ior in each subject began after the first met the critef-ia for stabil- 
ity. 



282 



VIDfTOTAPE FEEDBACK . At the beginning of this condition, the experi- 
menter showed the subj.ect how to record the target behavi^or. As in 
the previous xondi t ion, the daily instructions to the trainee included 
the definition and the criterion rate of the behavior. The trainee 
was required to score five minutes of the videotape of the previous* 
session before teaching. The experimenter scored simultaneously but 
independently and the trainee and experimenter compared records and 
scored reliability at the end of the viewing. 

Observation of the second behavior began when the first became stable. 
The trainee continued to score the first behavior when observation of 
the second one began, but the instructions were given only for the cur- 
rent target behavior. 

DIRECT INTERVENTION . Throughout this condition, the experimenter fol- 
lowed the trainee as he taught and continuously recortJed his behavior. 
At the end of each five minute period, thl^experimenter interrupted 
the trainee. and showed him the recording chart. If the behavior re- 
corded met the criterion, the experimenter praised the trainee and the 
trainee continued to teach for another five minutes. If the behavior 
had not met the criterion, the experimenter replaced the trainee and 
taught for three to five minutes while the trainee recorded." Whether 
or not the experimenter praised or replaced the tramee during this 
condition according to whether or not the trainee*s behavior met the 
criterion as prescribed by the procedure was assessed by an indepen- 
dent observer. The agreement between the experimenter and the Inde- 
pumJiii^H-observer as to the appropriateness of each intervention was 
100%. 



The sequence of conditions was as described for all subjects except 
Subjects 7 and 9- In order to provide additional information about 
possible effects of the sequence of experimental conditions, the direct 
intervention condition was first for these subjects, followed by video 
feedback. Instructions plus experimenter feedback was omitted from the 
sequence for these subjects. 



RESULTS 



The relative effectiveness of the three experimental procedures on 
praise is shown In Figure 1. Instructions and experimenter feedback 
had a variable effect on rate of praise. For Subjects 3 and 5, the 
mean rate of praise Increased during thi second! tion , whi le it decreased 
for the other two subjects. 

The effects of scoring videotapes of oneself teaching were similarly , 
variable. Mean praise rate increased for Subjects 1 and 4 during this 
condition, decreased for Subject 5, and remained unchanged for Sub- 
ject 3. During the direct intervention condition, however, the mean 
rate of praise was above baseline and above the means of all previous 
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'Fig. I. Rate of praise in four subjects during 
the experimental conditions. 

conditions for aKl four subjects. The increase In Subject 5*s mean 
rate of praise wasSmall; his mean >ate during the direct intervention 
was 6. A compared to 5.1 praises per minute during baseline. No %ys- 
tematic change' in praise rate occurred in Subject 2, for whom this be- 
havior 'was never manipulated. 

Simi lar relat ive effects en the rate of off-tjsk contacts are observed 
in Figure 2. The effects of instructions plus experimenter feedback 
are unpredictable. The mean rate of off-task contacts increased in 
two subjects during this condition and decreased in two others. Re- 
cording one's own videotapes reduced the rate of off-task contacts for 
all subjects, but did not eliminate it* The direct intervention condi- 

V 
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Fig. 2. Rate of off-task contacts in four subjects 
during all exper imef^ta I conditions. 

tion, however, brought off-task contacts to near zero for every subject 
A decreasing trend in Subject 3*s rate of off-task contacts was visible 
although this behavior was not manipulated. Her rate never stayed at 
zero for more than two sessions, while the rates of all subjects under- 
going the direct intervention procedure remained at zero for five or 
more consecutive sessions. 

Figure 3 shows the rate of praise for Subject 9, for whom the direct 
intervention conditi->n was the first manipulation-, and for Subject 5, 
who had the same baseline rate of praise. The abscissa is broken be- 
cause the instructions and experimenter feedback xondi t ion was omitted 
for Subject 9* The highest rate of praise for each subject occurred 
during the direct intervention condition regardless of this condition's 
position in the sequence of treatment procedures. 
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Fig. 3» Rate of praise in two subjects having the 
same base I ine rate when direct intervention was the 
first and the last experimental condition. 



DISCUSSION 

The consi stent- and repeated finding of this Investigation was that the 
direct intervention procedure was most effective in decreasing the rates 
of undesirable teaching behaviors and Increasing those that were desir- 
able. While the procedure was not infa11ib1,e, it produced marked 
changes In «lght of nine behaviors* The video feedback procedure pro- 
duced small changes In the appropriate direction In only slightly more 
than half of the instances where it was applied, and no predic£ab1e 
changes occurred as a function of Instructions and dally feedback. 



286 



The effects of any of the procedures might have been er anced if the 
-experimenter had consequences for the subjects' behaviors. All sub- 
jects in this study were volunteers who wanted to work in a free 
school (and did not necessarily want to undergo modification of their 
teaching behaviors). Had the experimenter been in a position to rein- 
force them soci.ally (as the princ*e*pals of schools are) or with grades . 
(as do the supervisors of student teachers) or monetarily, any of the 
procedures might have been more effective. 

Direct interA^entton may have been most effective because it provided 
the most immediate feedback of the three procedures. Video feedback 
is necessarily more delayed, a^ in this case almost twenty-four hours 
elapsed before the teachers scored their tapes immediately prior to 
their next teaching session. Thomas (1972) had teachers score tapes 
soon after teaching and reported systematic changes in a number of be- 
haviors across several subjects. 

T'he di f ferential effectiveness of direct intervention may also be due 
to the nature of the consequence applied for failure tomeet criterion. 
Comments by the trainees indicated that being replaced was aversive. 
This may. S|ipport the suggestion that the consequence of direct inter- 
vention isT^unctional ly similar to time-out. 

Finally, the effectiveness of the direct intervention procedure may 
have been due to the experimenter's modeling of correct responses for 
subjects who were replaced in the teaching si tuat ion. Because they 
had to "record the experimenter's behavior, the subjects were forced to 
attend. The effect of modeling might be assessed by comparing the 
present procedure with one in which subjects are required to leave the 
room when replaced by the experimenter. 

Two considerations concerning praise arose during the study. When sub- 
jects' praise rates increased there seemed to be a change in their ver- 
bal interactions with the children; they tended to ask more questions 
and to give fewer explanations* Thomas (1972) reported that praise and 
instructional prompts were Tnversely related* Further investigation of 
the interactions between praise and antecedent behaviors such as prompts 
seems warranted. 

£ 

Second, although no explicit instructions were gi vc:n to praise only 
children who were working, teachers almost never praised children who 
were off-task. More than 96% of all praise responses were to children 
who were working. The problem of changing teachers' praise behavior 
was not one of teaching a discrimination, as in the case of other ver- 
bal contacts, but one of teaching them to increase their rates. The 
data seem to support the experimenter's impression that teaching the 
discrimination is easier than teaching teachers to praise frequently. 

The results obtained must be qualified in two respects* First, addi- 
tional examination is needed on the effects of applying these three 
procedures in differing sequences. One attempt to exoand the data on 



this question was made. The rate of on-'task contacts v;as manipulated 
using different treatment sequences in Subjects 3 and 7- However, the 
experimenter increased the criterion on this behavior for Subject 3 
prior to the direct intervention procedure. Consequently, the data on- 
possible sequence effects- were confounded by the shifting criterion. 

A second qualification must be added until more data are available on. 
the durability of the observed effects. In the present study it was 
not possible to determine the extent to which the improved teaching 
behaviors would persist in the absence of continued feedback, and 
whether or not they would generalize to other classroom situations. 
Although not examined in this study, it is possible that any or^all of 
the experimental procedures may be useful In maintaining appropriate 
behavior 'even if they are less effective in supporting the initial ac- 
quisition of a teaching behavior. 

The results of this study have two broad implications for teacher train- 
ing. . The first is that direct intervention could be a useful on-the-job 
training procedure lior changing teacher behaviors. This sort of train- 
ing presumably occurs during student teaching, but presently there are 
few behavioral requirements for' student teachers or supervisors. Some 
student teachers are coached by their supervisors, others clean erasers, 
and some are abandoned, untrained, to teach the supervisor's class. In 
order for student teaching to affect teachers* behavior in any predic- 
table fashion, it must include behavioral goals and a procedure to help 
teachers meet these-goals. 

Second, 'if the specific, daily instructions to teachers in this study 
had little effect on their teaching, the i.nstruct ions which they re-- 
ceive in methods courses (sometimes preceding the teaching experience 
by a year or more) cannot be expected to control much classroom behav- 
ior. 

It seems reasonable to conclude that improvements in teachers* behav- 
iors are best made with on-the-job training that includes procedures 
designed to teach specific responses. 
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3 STUDENT STUDIES 
patricia m. pierson 

INTRODUCTIOL 

The three studies reported here v/ere done by a student, with a stu- 
dint, and for a student. They were conducted during my first year 
as a consulting teacher in training at the University of Vermont. 
Prior to the beginning of the first study, my only training had been 
a 'six-week summer school course in Behavior Analysis. Twelve years 
before, I had taught in an elementary classroom for three years but 
the intervening time had been spent in the diaper pail and behind 
the i roning board. 

The studies were completed as part. of a course requTrement. The 
first study was don3 by Miss Phyllis Marcel 1, a student in a grad- 
uate course in BehaV^ior Analysis. The other two studies were com- 
pleted as part of a certification workshop that I. planned and taught 
The teachers were Miss Barbara Butler and Mrs. Constance Miles. Con 
stantly on hand during all three studies with advice and encourage- 
ment were my advisor. Dr. Edward Hanley, and Mrs. Betty Jane Lates, 
consulting teacher for the Burlington School district. 



EXPERIMENT I 



Subject and Classroom 

Fred was a nine-year-old boy who had been in an Educable Retarded 
classroom for the past two years. He scored 71 on the WISC test, 
had a reading level of 1.3, a spelling level of 2.2, and an arith 
metic level of 2.6, in Spring, 1970. Twelve children were in the 
class, ranging In ages from seven to ten. The classroom was part of 
a regula* elementary school. 
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Behavior 

Fred did" not complete his work assignments although the teacher knew - 
he was capable of doing so. '•He tired easily, was often sleepy and was 
frequently absent due to illness. The behavior desired was defined as 
completion of arithmetic work during a 20-minute period with 80% ac- 
curacy. 



Measurement and Reliability - Procedures 

The teacher recorded daily the percent of problems completed and^the 
percent of problems correct. Reliability was obtained by an observer 
checking the teacher^s computations weekly. The student's work was " 
done in a notebook, and consisted of two digit arithmetic problems 
which were written by the teacher. The student wrote his answers in 
^the book. Due to the simplicity of the assignment and the fact that 
it was not corrected by the child after the teacher marked it, the re- 
liability was always 100^. 



Teaching /Learning Methods and f4aterials 

Problems given were two and three place addition a)id subtraction with- 
out regrouping. Twenty problems were assigned each day. 

Baseline 1 - - 

The teacher assigned work and recorded daily the percent done and the 
percent correct. 



Contingency I 

If Fred finished ten problems with 80| correct, he received one chip; 
he received another .for the next ten done with the same accuracy. Two 
chips were used to buy food to be eaten at snack time. No chips could 
be accumulated toward the .next day. 



Scientific Verification 

The teacher stopped giving Fred the chips; hence, he could not buy a 
snack. 



Contingency II 

The teacher resumed giving Fred the chips and he was again able to buy 
a snack. 
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Posteheak 

Four months later, the teacher noted that* Fred continued to finish his 
work and scored 80% or above. 



RESULTS 

Figure 1 shows the number completed of assigned arithmetic problems. 
During the baseline period, Fred completed an average of twelve prob- 
lems v/i th a range from nine to fifteen. During the first contingency 
his average rose to eight.een problems with a range of ten to twenty. 
During scientific verification, when he no longer received tokens, his 
average dropped to ten with a range of seven to twelve. When tokens 
were reinstated in contingency II, his average number done rose to nine- 
teen with a range of six to twenty. Postchecks showed he was continuing 
the good word. 
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Figure 2 shows that the percent correct generally followed the same 
pattern as the number completed • During both contingencies Fred was 
S0% or more accurate fifteen out of twenty-three times. 



DISCUSSION . 

The use of tokens with snacks as backup reinforcers was found to be 
an effective systemfor Fred. The teacher then decided to use these 
procedures on a daily schedule. Fred got one token for his morning's 
work being completed, one for reading work completed and a third for 
completion of afternoon work. }ie was allowed to exchange tokens for a 
snack at the end of the day. The teacher reported he had earned his 
snack every day except one when she was absent and not there to admin- 
ister the tokens. 



EXPERIMENT II 



This study was done in Spring, 1970, as part of a certification work- 
shop. 

Subject and Classroom 

Patty was a seven-year-old girl in a first grade class from a middle 
income area. She hffd had problems in school kindergarten and was re- 
ported to have spent most of that year hiding under a table. She<5had 
been referred to a family counseling service where no specif ic- reason 
was found for her behavior. This was her second year in first grade, 
her first year in this school* ^ She was tested on the Wechsler Test 
In June, 1970, and scored 80-90, 

Behavior 

Patty's social behavior was greatly improved in school. She took part 
in class activities and was well liked by her classmates. She was un- 
able, however, to, follow directions or complete her written work so 
that, even though she was a good reader, her grades were poor. Her 
behavior at home was erratic and her parents reported that she was dif- 
ficult to handle. 



Reliability Procedures 

Patty's work was corrected immediately upon cojnpletion, and a token 
card v/as given. During Contingency II, when the card could be ex- 
changed for gifts-in kO%, 60%, B0% or 100% categories, the cards were 
made out to the nearest of those percents, and If the score wes in the 
mid^le^ the higher category was granted. An observer checked Patty's 
workbook weekly. Because responses, were highly objective and the teach- 
er was very precise, there was always 100% reliability. 

Teaching /Learning Methods and Materials 

Patty was reading in the Scott, Foresman book, Level 2. After the ses- 
ion with the reading group, the teacher would explain the workbook pages 
and the ch i Idren would do them at their seats. 



Baseline 1 * ^ 

During the baseline, the teacher kept a record of the percent done and 
the percent correct of Patty's reading workbook ass ignment. 
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Contingency I 



When Patty completed all of her reading workbook assignment with at 
least 75% correct, she got a happy face card to take home* Her mother 
would give her five cents for each card* After eleven days it was 
clear that this contingency was not strong enough, to mo.dify Patty's 
behavior. 



Contingency II 

Patty's mother took her shopping and she chose toys and candy of vary- 
ing worth which were kept on a shelf at home* Examples were: packages 
of gum; one stick in the kO% category, two sticks in the S0% category,^ 
etc», play make-up set; powder In thj kO% range, lipstick in the 60^ 
range, etc. The 100^ category prize ;was a ''Dawn*' doll* 

Patty had to get 100% of her work completed, and was given a happy 
face card for kO%,' S0%, 80% or 100% dorrect.. These were exchanged at 
home for the gifts on the shelf ]n the proper percent category. _ 



The teacher was unexpectantly absent and Patty was unable to get her 
card to take home. 



Contingency III 

Patty continued earning cards when 100% of her workbook assignment was 
completed and was given a happy face card in the percent category she 
had earned* these cards continued to be exchanged daily for gifts at 
home, in the appropriate percent category. 



Figure 3 shows percent of work done* During baseline, Patty varied be- 
tween 0% and .100%, with an average of 50% completed. Contingency I 
ranged from 0% to 100% with 49% average, During Contingency II, Patty 
completed both assignments, but during Reversal she completed only an 
average of 12% of her assignments* Percent completions varied between 
50 and 100 in Contingency III with an average of 97%. 

The data for percent of work done correctly is shown in Figure k. Dur- 
ing baseline, Patty varied between 0% and 70% correct with an average 
of 35% correct* During Contingency. I the range was 0% to 90% correct 
with an average of 37% correct* Contingency II showed a range of 5^% to 
75% with an average of 64%. During the Reversal period, scores were 10% 
and k7% correct* 



Reversal 




RESULTS 
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In Contingency III, the range was ]Z% to 100% correct with an average 
of 70^ correct. 
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This study shows a dramatic increase in the amount of work Patty com- 
pleted during Contingencies II and IN, and a definite increase in 
^ accuracy. The unplanned Reversal provided a ver i f icati on.of the rein- 
forcing effects of the cards. -When the teacher returned during Contin- 
gency III, Patty immediately resumed her high percent of work completed 
and continued to earn a card for at least 60% correct every day but one* 
The parents reported a great change in Patty's behavior at home. She 
was more stable, completed household tasks, and showed more initiative 
around .the home. 'After Patty had earned her 100% correct gift, the 
"store*^ was . replenished and the cards were made contincent upon doing 
the entire morning's class work. Patty did not keep up her former lev- 
el of work done and accuracy, but the parents reported that, her home be-,, 
havfor was still good and the procedures are being qontinued. 

EXPERIMENT III 

This study was completed during Spring, 1970, as part of a certifica- 
tion workshop. 



Subject and Classroom 

Connie was a seven-year-old girl in the first grade. The preceding Fall, 
Connie had tested 36 (low-medium) on the Metropolitan Readiness Test. 
This study was carried out in the learning center where Connie's class 
met dai ly. 

Behavior 

Connie attempted little of the assigned work duri^ig a 30-minute learn- 
ing center period* When she hurried through the work at the end^of the 
period, it was inaccurate. Connie's printing was poor* Her teacher 
asked her to copy a model letter, upper case on one side of the paper, 
lower case on the othei^ as many times as possible in a IS^mlnute period. 
Each day one letter was given, starting with A and going In alphabetical 
order. The first five letters given during the baseline were repeated 
again when contingency was started. The three letters assigned during 
the Reversal period were also repeated, at Connie's request. 

Measurement and Reliability Procedures 

The teacher counted the number of correctly formed letters, on the basis 
of the overlay. An observer checked the papers once a week, also using 
the overlay. Because of the thicker overlay letters, it was very simple 
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to judge whether or not the letter should be counted as accurately 
formed; thus, agreement was always 100%. 

- Baseline 1 

The teacher gave Connie a pencil, an eraser, and lined paper with one 
model upper case letter on one side and one model' lower case letter 
on the other, ^ At the end of a 15-mlnute period, the teacher collected 
the paper. 



Contingency I 

The teacher made a special loose leaf notebook for Connie, When 
Connie accurately formed at least ten le*:ters during the 15-mlntite 
period, she was allowed to put the page in the book and take It home- 
The teacher also went to Connie at 3"mlnute intervals and checked her 
work for accuracy. 



Saientifio Verifiaation 

The teacher kept Connie's - notebook. Furthermore, she did not make 
checks for accuracy at 3-minute intervals. 



Contingency II ' - * 

For the first four days the teacher reinstated the 3-minute accuracy 
checks. The notebook was then returned on the fifth day. 



Thinning 

The time period was .shortened to 7 1/2 minutes, and the teacher made 
one accuracy check in the middle of the period. 

RESULTS I 

Figure 5 shows that during baseline the number of accurately formed 
letters ranged 0 to 3, with an average of "1. During Contingency I, 
there was a range of 8 to 21 correct letters, with an average of \k 
correct.* During Scientific Verification, correct letters ranged from 
1 to 18, with an average of In Contingency II, the range was 7 to 
25, with an average of 15. When the Thinning process was instituted, 
the range was 10 to 19, with an average of 13 correct letters. 
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DISCUSSION 

Connie's rate of correct letter formation increased during both con- 
tingency periods* The S^nilnute checks by the teacher, when reinstated 
alone during the second contingency for the first four days, showed 
that this was as effective a relnforcer as the notebook. The rate 
stayed almost exactly the same when the notebook was returned. During 
the,-*Th Inning procedure when Connie was allowed half as much time to 
work and the teacher made one check, she still maintained an average 
of 13 letters. 

The teacher reported that Connie , took great interest in her writing 
work; she asked to do over the letters that were assigned during the 
Reversal period, and she was able to tell the teacher which would be 
the correctly formed letters before they were checked with the overlay. 



PART 6 



PROGRAMS YjTLCHNIQUES 
VX IN 

BEHAVIOR ANALYSIS' 




■i 

f 

I 



ERIC 



The 

experimental analysis - 

Of A 

HOMEWARD EDUCATIONAL PRO&RAM 
^ WITH A PRE-DEUNQUENT JUVtMILE 

martin j. pollack 
bath sulxar^az^roff 
raad williams' 

Education related behaviors have been examined by manipulating tests 
and homework using varying schedules, of presentation (Malott and 
Svinicki, 1969; Bostow, 1970; Bostow, Mawhinney, Blumenfeld and Laws, 
1971)* These studies have concentrated on normal populations. Re- 
sults generally indicate greater consistency and higher rates of be- 
havior for daily schedules than for intermittent schedules. Addi- 
tional research has established the efficacy of using behavioral ob- 
jectives in instructional settings (Mager and Clark, 1963; Miles, 
Kibler and Pettigrew, 1967). In the present research, the independent 
variable was the manipulation of a schedule of contingencies in the 
form of assignments. Daily and weekly assignments were contrasted and 
performance was measured in terms of number of assignments completed 
to determine whether homework production would be differentially af- 
fected by the schedule used. A token system using points and home re- 
inforcement procedures was added as part of a program designed to bring 
the student under control of the contingencies for academic work. The 
program was applied here to a pre^delinquent high school youth who was 
out of school at the time of the study. 



METHOD 

Subject 

The student was a sixteen-year-old male classified by the high school 
as ppe-delinquent* Behavioral characteristics included a sparse ver- 
bal repertoire, little activity and, especially, excessive sleeping. 
No medical justification for this condition was revealed by an examin- 
ation. The home environment was a compact living space for both par- 
ents and six siblings, but showed no evidence of economic deprivation. 
The student had a history of oecltntng attendance over the past two 
years and a ^^D^^ academ^ average despite normal range intelligence test 
scores. ^Deficiencies were particularly severe in spelling and mathemat 
Tcs. The student had been expelled for truancy at the start of the 
study. 



Grateful acknowledgment is extended to David Miles, 
John Deichmann and Jerry and Jean Ulman for their helpful_ sug- 
gestions and common fs. 
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Experimental Setting and Materials 



The experimenter visited the student at home daily bTpagreement-wth 
the student and the student's parents. Programmed texts In spelling 
"and mathematics (Hook, 1967; Hauck, Moore and Smith, 1966)'were used 
together with written assignments which included behavioral require- 
ments and due date6« Problems and sentences using spelling words 
were the operations required. Tokens' in the form of points were pro- 
vided contingent upon completion of assignments on time for two aca- 
demic subjects and were exchangeable for back-up reinforcers provided 
by parents and the experimenter. A list of reinforcer prices (see 
Table 1) and records indicating academic progress in terms of assign- 
ments completed were available to all parties. 



TABLE 1 

LIST OF REINFORCERS AND PRICES 



REINFORCER 


POINTS REQUIRED 


CONDI T+ONS 




. f 

• USE OF CAR 

• HOVIE 

• ATHLETIC EVENT 

. • ACCESS TO MECHANIC 

• BOATING 


? 

90 
WO 
100 
90 
90 


T 

Time Speoified 

■ Per Hour 
Per Hour 



Procedure ^ ^' 

Diagnostic testing was done with, sample materials for each academic 
category prior to the start of the program. The experimenter was thus 
assured that the student could perform the tasks involved and was able 
to function at the level demanded by the program. The student was 
started at the beginning of each program based on scores of 38.7^ cor** 
rect for spelling and S0% correct for mathematics. The program em- 
ployed a token (point) reinforcement system in which 100 points were 
delivered to the student each week contingent upon punctual completion 
of all assignments, either \iaily or weekly, for that week. Daily ses- 
sions included recording of work completed, testing over assignments 
when completed, requests for token exchanges, additions to the back-up 
reinforcer list and answering questions. Daily records of completed 
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assignments were kept and cumulative graphs were drawn as the program 
p$:ogressed. The terminal performance was specified as the completion 
of all requirements for each assignment. 

The experimental design ^consisted of two counter-balanced reversal de- 
signs in spelling and mathematics (Baer, Wolf and Risley, 1968). 
Scheduling of conditions for the two subjects was varied according to 
the sequence indicated in Figure 1. 

The program was arranged so that during the same week in which the 
baseline condition was in effect for one subject, one of the two ex- 
perimental conditions was in effect for the other subject. The exper- 



SI>aLING 



^ Ul 
< Ul 
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CONDITIONS 




Fig. I. Cumulative graph of assignments completed across 
conditions for each academic subject. 



\ 



imental conditions alternated from subject to subject (spelling to 
mathematics to spel 1 1 ng» • • • ) , and within each subject between dally 
assignments and weekly ass Ignments' wl th succeeding weeks. Baseline 
conditions were Interspersed between each experimental condition for 
each subject. 

Baseline (No Assignment) . Reinforcement was not available for any 
work completed. Assignments were not given, so, the student could 
work-in the materials as desired, or do no work whatever. Daily re- 
cords were kept of any work completed. 

Dai ly Assignments . Reinforcement occurred only If each of five as- 
signments for the week were completed 'as specified. Verification of - ^ 
assignment completion was made via dally data records. Delivery of 
points took place at the end of the five day week. One hundred point™ 
were given for completion of all five daily assignments on time. Par- 
tial or non-completion, of any one of the five assignments resulted in 
no points, regardless of other ^assignments completed. 

Weekly Assignments . Re I rrf or cement occurred only- if the large single 
assignment was completed entirely. "Delivery of points took place at 
the end of the five day week on the same day the ass ignment was due. 
One hundred points were given for completion of the single assignment. 
Prtial or non-completion of the assignment resulted in no points. 

The three conditions and the reinforcement system were explained to 
.the student at the outset. For each of the subjects, assignments and 
completion dates were specified orally and in writing on behavior unit 
forms. The student was asked to present all math or spelling work com- 
pleted (at the start of each dally meeting, regardless of the schedule 
in effect or the academic material assigned). 

The number of completed items required for assignments given from week 
to week was kep.t constant insofar as possible. This allowed for a com- 
parison of performance in different weeks and under different condi-* 
tions. Weekly assignments contained approximately 100 items. In order 
to maintain comparability between daily and weekly assignments, daily 
assignments were constructed with approximately 20 items each. Devia- 
tions from these figures were due to attempts to maintain continuity in 
the materials. For example, an assignment which consisted of precisely 
20 items but which fell two or three items short of completing a unit, 
or extended into the next unit by a similar number, were altered appro- 
priately in an upward or downward direction. 

Failure to complete assignments had no effect on the choice of materials 
for succeeding wee';s. Rec>xling of materials was rejected since such a 
practice might Work counter to the contingency which required completion 
of assignments by a specified date. Past materials were, however, avail- 
able to the student as a potentially useful aid in completing assign- 
ments for which contingent reinforcement did exist* The student could 
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purchase reinforcers as long as he had earned enough points to pay for 
them. Those relnforcers which took the form of events or priveleges 
were arranged as expediently as possible for a mutually agreeable 
time. 

At the completion of the program, an unannounced retention test con- 
sisting of representative" Items from each of the tests over Individual 
assignments was administered for each subject. 



Results 

The results show that completion of assignments was controlled In a 
highly predictable fashion. Dally assignments prc^uced steady dally 
performance while weekly assignments produced a pattern that acceler- 
ated Immediately before the due date. Over a nine-week period, all 
four weekly and nineteen of twenty dally assignments were completed' as 
specified. Performance on only two of the twenty-three tests fell.be- 
](y^0% cdrrect. The mean across conditions was 85-8% correct for 
spelling and 77.2? correct for mathematics. The mean correct for all 
dally spelling and mathematics tes^ts was 80%, while the mean for all 
v/eekly tests was 30% correct. 

Retention test scores were 62.5% correct for spelling and 82.5% correct 
for mathematics. These scores represent'a positive change of 23-5% and 
22.5%, respectively, over entering test scorers. Error rates were not 
noticeably different for dally and wee'kly* schedules. 



Discussion 

The data present clear evidence that control and prediction of this 
student's homework behavior could be achieved by manipulating tests 
and the time requirements placed on assignments. The data lend further 
support to the contention. that academic performance can be brought^ffder 
schedule control . 

- An analysis of the motivating factors In the program Is appropriate. 
The s|udent accumulated a total of 700 points but did not attempt to 
exchange them for back-up relnforcers unt:Il the seventh week when he 
purchased mechanics training. This occurred despite the fact that the 
student could choose relnforcers at any time. This suggests that the 
back-up relnforcers might not have been crucial for the student. Some 

" evidence is available to suggest that points. alone can temporarily 
serve. as relnforcers (Sulzer, Hunt, Ashby, Krams and KonlarskI, 1971). 
Another possible source of reinforcement was In the form of attention 
from the experimenter via his daily contact with the student through- 
out the program. 



The presence of tests consistent ly following each assignment is a var- 
iable worthy of consideration. Since the student scored on the aver- 
age above 80^ correct on the tests, a performance considerably better 
fhan recent school experiences, the tests may have functioned as a 
leinforcing event following the completion of the assignments. Indiv- 
idual or cumulative effects of these potential reinforcers may have 
contributed to the control .achieved, 

—a- - - * ' 

The data also provide evidence to show that a large amount of mater- 
ials could be completed with assignments with longer time requirements. 
There was no difference in total production with daily and weekly as- 
signments with the exception of "the last day, JGiven that future re- 
search does not indicate differential retention associ ated wi th the two 
conditions, itwould apfH^ar -that the weekly assignment is more desir- 
able if positively accelerated patterns of responding are acceptable. 

The effectiveness of the procedure for applied settings is emphasized 
by its success with a student whose academic history includes a neg- 
ligible amount of completed homework. The desired patterns of respond- 
ing were obtained by using the appropriate schedule. During all four 
weeks of daily assignments, the student completed homework for four 
successive days in the absence of any reinforcement (tokens) built in- 
to the system. Only on the fifth day could his efforts be rewarded* 
The apparent willingness to wait for the payoff is particularly signif- 
icant for this individual since he has progressed from no measurable 
performance to specified performance under a schedule as lean as a 
weekly interval schedule. 

Attempts to generalize these results through replication with a group 
design would be a logical next step. The length of the interval could 
be explored as well to determine the one most efficient for a program. 
Variability in retention as a function of changes^ in length of the in- 
terval would be an important consideration in choosing the schedule most 
suitable for a particular setting. 
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auto-pedestrian safety project 
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The analysis of five years of police accident data for Salt Lake City 
showed that there had been a yearly Increase in the number of traffic 
accidents Involving automobiles and pedestrians* The police data al- 
so showed that more children between the ages of five and nine (about 
twelve percent of the population) were Involved In traffic accidents 
each year than any other comparable age group. Although these data * 
do not reflect the number of people In the different age groups that 
were susceptible to accidents by their mere presence on sidewalks or 
streets, this low age group was chosen for pedestrian safety training 
because of the apparent high incidence of accidents in this group and 
because of the great interest and support- for pedestrian safety in 
children. > ^ 

The notion of changing the pedestrian behavior of elementary aged chil- 
dren was certainly not new. Most Salt Lake schools had some sort' of 
program aimed at making children become good pedestrians. However, 
the ef fec"tl veness of these attempts had never been shown. It was hy- ' 
pothesized that the apparent lack of effectiveness of these programs 
was due to the absence of any direct modification procedures. It 
seemed unlikely that a child would learn to stop and check traffic at 
a street corner simply because of verbal warnings or instructions given 
in a classroom, especially in the absence of any reinforcement contln* 
gencies. The safety programs conducted by elementary schools (and other 
groups) in Salt Lake City did not include any direct manipulations of 
relnforcers relatec^ to pedestrian behavior itself. The purpose of this 
study, then., was to demonstrate a procedure by which the pedestrian be- 
haviors of elementary-aged children could be modified by school person- 
nel or volunteers and to show that the changes in pedestrian behaviors 
observed were functionally related to the procedures used. 



METHOD 



Subjeots 

The subjects were male and female elementary school students who attended 
a summer program at Bonneville School in Salt Lake City. More specific- 
ally, those students who left the school between 9:^5 AM and 10:10 AM, 
10:45 AM and 11:10 AM or 11:45 AM and 12:10 PM, and crossed at or between 
corners A, B and C in Figure 1 participated in the safety project* 
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Fig* I. Intersections in Experimental Area at Bonne- 
ville School • 
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Apparatus and Situation 

The project required the following equipment: ten slng% event hand 
counters, assorted pads and pencils, and clipboards. 

The three intersections nearest the school (see Figure 1) and the street 
area between these intersections were designated as the experimental 
area. 



Personnel 

Eight female high school students- functioned as data collectors and be- 
havior rrodifiers. The girls were trained and their subsequent project 
behavior was monitored and modified by three project coordinators from 
the Bureau of Educati^onal Research at the University of Utah* One teach- 
er from the Bonneville School teaching staff (who was also the" summer 
school coordinator) assisted in schedul ing assembl ies- and facilitating 
communication between school personnel and the project coordinators. A 
University of Utah work-study student directly supervised the high school 
students in many of their duties and assumed the added responsibility of 
assisting in the collection and compilation of the data. (If this were 
not an initial, research study, fewer personnel would have been needed.) 



Procedure 

OBStRVATION. Prior to the formal collection of data, motorist and pe- 
destrian behaviors were observed. As a consequence of this observation 
period, pedestrian street crossing behavior was designated as the de- 
pendent measure. Appropriate street crossing behavior was defined as: 

A pedestrian approaching an intersection on foot was to break 
stride and come to a complete stop at the curb of the inter- 
section, make discreet observing responses in all directions 
of potential traffic flow for a period of at least three sec- 
onds, and then proceed across the street within the confines 
of the pedestrian crosswalk. In those instances where an ade- 
quate view of potential traffic flow was obstructed by parked 
cars the pedestrian was to proceed (after a three second ob- 
serving response at the curb) slowly into the street until a 
safe position with an unobstructed view of traffic had been 
reached close to the traffic side of the parked cars, then 
pause-for another three seconds and make disc^'eet observing 
responses before crossing the street. In addition to the 
above requirements, bicycle riders were to di'smount at the 
intersection curb and walk their bicycles across the street. 
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BASELINE, During the baseline period, data were gathered at intersec- 
tions A, B, and C. The percent appropriate crossings occurring at the 
three intersections was tabulated separately for each of the three time 
designations. Only 'pedestrian crossings from the block that the school 
was on were counted. Data collectors were positioned so as to have an 
unobstructed view of the five crosswalks shown in Figure 1 and of the 
street area in between intersections A and C on 19th East, Any stu- 
dent leaving the school block within fifteen feet of the corners of 
19th East and Yale or 19th East and Princeton were observed and counted 
also. The total number of street crossings and the total ngmber of ap- 
propriate crossings were recorded on hand 'counters between 9:^5 AM and 
10:10 AM,- between 10:45 AM ar.d 11:10 AM, and between 11:45 AM and 
12:10 PM, 

Reliability checks were taken during each of the experimental conditions 
by having a second observer, usually one of the^project coordinators, 
record crossings independently of the observer assigned to that inter- 
section. 

MODIFICATION, Each of the three time periods (9^:45 AM -10:10 AM; 
10:45 AM - 11:10 AM; and 11:^5 AM - 12:10 PM) was designated as a sep- 
arate experimental condition. In accordance with a multiple baseline 
procedure (Baer, Vfolf and Risley, 1968) -modi f icat ion procedures were 
begun separately for each of the three time periods. On the day that 
modification was to start for the children leaving between 9:45 AM and 
10:10 AM, an assembly was held for these children. The assembly pro- 
gram included a short lecture by a project coordinator, a brief question 
and answer period, a demonstration of appropriate street crossing be- 
'haviors, and a roje playing period during which several students were 
chosen from the audience to demonstrate correct street-crossing behav- 
ior. The assembly programs lasted about 20-30 minutes. 

Starting with the day of the assembly, the children leaving the school 
between 9:45 AM and 10:10 AM were reinforced for crossing the street in 
the manner demonstrated in the assembly, and as defined previously. 
The person who dispensed reinforcers would greet the child as he com- 
pleted his crossing by saying, ^'That was a good job of crossing the 
street;** or something similar, and would then give the child a piece of 
candy, a smile, and a Good Pedestrian Citation (see Figure 2), The 
same procedures were used at all three corners. An observer recorded 
the total number of crossings and the nurrfcer of appropriate crossings. 
Baseline recording continued during the 10:45 AM - 11:10 AM and 11:45 AM 
12:10 PM periods. 

Two days after the start of the rrvDdi f ication procedures for the 9:45 AM 
10:10 AM group, the same assembly was held for all those children who 



This Is to certify that 

was a safe walker on , 197 , and 

that on the corner of and 

, he/she stopped/ looked . 

both ways, and then carefully crossed the 
street. 



Principal 



Fig. 2. Example of *'Good Pedestrian Citation." 

left the school between 10:^5 AM and 11:10 AM, Reinforcement procedures 
for appropriate street crossings were started on all three corners just 
as they had two days earlier for the students leaving at the earlier 
time. Baseline recording continued for the 11:^5 AM - 12:10 PM period. 

Three days after the start of the modification procedure for the 10:^5 AM 
11:10 AM time period, the same assembly was held and the reinforcement 
procedures were implemented for the children leaving the school between 
11:^5 AM and 12:10 PM. At this time, and continuing until .the end of 
the project, the reinforcement procedures were in effect on all three 
corners during all three time periods. 

RESULTS 

Baseline 



Figure 3 shows the percent of appropriate street crossings during base- 
line for all three time periods. The percent of appropriate crossings 
was low and stable for all three groups. 



Modification 

The effect of the modification procedures is also shown in Figure 3» 
The percent of appropriate crossings during the 9:^5 AM - 10:10 AM 
period increased greatly in session seven, the first day of treatment. 
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Fig. 3. Percent of appropriate crossings as a func- 
tion of sessions. 



The rate of appropriate crossings remained high^ never falling below 
63% for the remainder of the project. Similarly vhen x^e modi ff ca- 
tion procedures 'were instituted for the 10:45 AM - .1:10 AM group^ 
the percent of appropriate crossings increased to 6C% and^ remained 
high. When the same procedures were implemented in the 11:45 AM - 
12:10 PM period, a similar rise in the percent of appropriate cross- 
ings occurred. Figure 3 also shows that when the modification proce- - 
dures produced an increase in the rate of appropriate crossings in the 
9:45 AM - lOllO AM period, the relative rates for the other two time 
periods with baseline procedures still in effect remained low. When 
the same procedures were instituted in the 10:45 AM ~ 11:10 AM period, 
there was an immediate increase of appropriate crossings (65%), while 
the rate for the 11:45 AM - 12:10 PM period, with baseline procedures 
still in effect, remained low. Likewise, instituting modification pro- 



cedures for the latter time period produced^ an Immediate increase of 
61^ In the rate of appropriate crossings. During the remainder of 
the reinforcement procedure, the rates remained relatively high and 
stable In all three time periods. The percent of inter-observer agree 
ment during the six reliability checks was never below 95%. Reliabil- 
ity was figured on the basis of the percent of inter-observer agree- 
ment on the nurr^er of appropriate crossings on each corner. 

The average number of students who left between 9:45 AM and 10:10 AM 
was 35. Between 10:45 AM and 11:10 AM the average was" 32.4, and be- 
tween 11:45 AM and 12:10 PM it was 51.7. 



DISCUSSION 

The results of the experimental procedures support the contention that 
appropriate street crossing behaviors can be defined, measured and mod- 
iffed. Because of the limited amount of time that was available for 
this project, some variables were not investigated. It would have been 
of interest, for example, to demonstrate the differential effects of 
reinforcement vs. instructions on street crossing behaviors. Past re- 
search (Ayllon and Azrin, 1964) Indicates that instructions given with- 
out providing consequences for the behavior have short term effects. 

Another problem is that, the time limitations did not allow for the dem- 
onstration of the durability of the newly acquired safe street crossing 
behaviors. The procedures that would have l^een used here, and the one 
that is recommended, is to have employed some form of an intermittent 
schedule of reinforcement. This wou^d be done by gradually dropping 
reinforcement procedures, on a few days, but still providing them on the 
others. There is a large amount of research which shows that once a re- 
sponse had been conditioned, it can be maintained for long periods by 
providing intermittent reinforcement (Perster and Skinner, 1957; Mech , 
1953; Fattu, Mech and Auble, 1955; and Long, Hammack, May and Campbell, 
1958). Nevertheless, this study demonstrated that efficient and easily 
applied behavior modification techniques can be used to modify pedes- 
trian behaviors in children. 
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A PROGRAM OF 
DELAYED CONSEQUENCES 
FOR THE 

MANAGEMENT OF CLASS ATTENDANCE AND 
DISRUPTIVE CLASSROOM BEHAVIOR OF 
124 SPECIAL EDUCATION CHILDREN^ 

hewitt b. dark 



A great dea) of research has focused upon the elimination of classroom 
behavior considered to be competing with participation in study activ- 
ities. The procedures researched have, for the most part, involved con- 
sequences which were administered within the classroom setting (e.g., 
Barrish, Saunders and Wolf, 1969; Birnbrauer, Wolf, Kidder and Tague, 
1965rHall, Fox, Willard, Goldsmith, Emerson, Owen, Davis and Porcia, 
1971; Herman and Tramontane, 1971; O'Leary and Becker, 1967; 0*Leary, 
Becker, Evans and Saudargas, 1969; Schmidt and Ulrich, 1969; Thomas, 
Becker and Armstrong, 1968; andVolf, Giles and Hall, 1968). The man- 
agement of classroom behwiors through the use of delayed consequences 
administered in home settings has been researched by Bailey, Wolf and 
Phillips (1970) and McKenzie, Clark, _Wolf, Kothera and Benson (1968). 
The present study was designed to extend the results of the McKenzie 
et aK study and the Bailey et al . study by examining the use of de- 
layed consequences in the management of class attendance a^ classroom 
disruptive behavior of a relatively large population of children. The' 
children, numbering 124, attended a special education school and lived 
in cottages at a residential facility for mildly and moderately re- 
tarded children. The delayed consequences for school attendance and 
disruptive classroom behavior were differentially applied each evening 
by the cottage-parents. The-present study involved two experiments. 
The first was designed to evaluate the program of delayed consequences 
on class attendance. 



The author wishes to express his gratitude to Miss Donna Mae Ida, 
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many other research projects. The author would also like to give a spec- 
ial thanks to Mrs. Sandra Boyd and Miss Susan Brothers for their help 
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project would not have been possible without the cooperation and assist- 
ance of the personnel of the Education Uniy at Western Carolina Center. 
To them, I am indebted, as well as to the Office of Mental Health 
which provided the support for this project. 
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GENERAL METHOD 

The subject population of this research consisted of 124 children, ages 
9rl6, who had been insti tutionaT ized due to such circumstances as: 

(1) their having a history of being too disruptive 
for public school special education classes; 

(2) their community public school r>ot having a spec- 
ial education program; or 

(3) the state courts having no alternative facili- 
ties available to receive children of these 
ages who have come under court jurisdiction, ^ 

At the institution, the children resided in four cottages. Each child 
was scheduled to attend six hours of special education classes each day, 
Monday through Friday. The classes were held in a school building sep- 
arate from the cottages. There were 14 special education teachers in the 
school, each with a different curriculum area (e.g., reading, numbers, 
communication skills, community living, home economics and prevocational 
training). The children were to go to a different curriculum area class 
each hour. They were allowed to leave class on the hour and were re- 
quired to be In their next class by ten minutes after the hour In order 
to be counted as ''present.'' 

In both the school and the cottages, the children were on a token system. 
Within the school the children received plastic strips and praise imme- 
diately contingent upon appropriate classroom and academic behavior. At 
the end of each class period the number of tokens earned was marked in a 
token book carried by each child. The marks in the token books were trans- 
ferred Into each chi ]d l€r-t oken bank account daily. A child could take out 
of hU bank account whatever quantity of his token coins he wanted to 
spend. The token coins could be exchanged for a variety of evening activ- 
ities, such^as dances, movies and organized recreation. These coins could 
also be exchanged for spending money or used to purchase clothing and a 
variety of items from a novelty sdtore. 

Each evening there was a meeting of all residents In each cottage. T Each 
child who attended this meeting received 25 tokens. Each child who missed 
the meeting was fined 100 tokens and was placed in bed for the rest of the 
night when he was located. The evening meeting was used to inform the 
children of what activities were scheduled for the evening. 



TXPERIMEWT I 



This experiment was designed to evaluate the use of the program of de- 
layed consequences for the management of class attendance. A sample, al- 
though not an experimental analysis, was also provided in this experiment 
of the program's effectiveness in the management of disruptive classroom 
behavior. 



METHOD 



Measurement^ of Class Attendance 

A record of class attendance was made each day by each teacher on an 
Attendance Form. This form contained a listing of all the children's 
names In alphabetical order and two columns in which marks could be 
made beside each name. For each class, the teachers would check roll 
at ten minutes after the hour and indicate each child^s presence by 
placing a check in the first column next to the child's name. Only 
those children who arrived in class before ten minutes after the hour 
and remained throughout the , hour were counted as '^present/' 

Once each day, the reliability of each teacher's attendance record (At- 
tendance Form) was checked. This was accomplished by having an observer 
drop by each teacher's classroom at a different class hour each day and 
make an Independent record of the children "present." The teacher's re- 
'cord and the observer's record were compared to determine the number of 
agreements (I.e., both the teacher and the observer had checked the child 
as present) and the number of disagreements (I.e., either the observer 
had not checked a child and the teacher had or vice versa). A reliability 
estimate was calculated across all teachers by dividing the total number 
of agreements by the total number of agreements plus disagreements. The 
mean reliability for the teachers' attendance records was 98?. 

After the last class of the school day all the Attendance Forms were 
collected and the attendance information collated for each child. The 
collation was used to obtain a percentage figure for each child indicat- 
ing the proportion of his classes he attended. The percentage figures 
were corrected to compensate for excused absences. 



Measurement of disruptive Classroom Behavior 

To provide an estimate of the effect of the treatment program on the 
rate of disruptive classroom behavior, measurements were made In one 
classroom (11:00 math class) of out-ofseat behavior. .Due to the lack 
of observer staff, these observations were done only under the first 
two' conditions of the study, and then only on a few days of both condi- 
tions. On those days on which a classroom observation was taken, two ob«- 
servers made a 15-minute sample of the number of 10-second intervals in 
which one or more children were out of their seat without permission. 
The observer's records were later compared at each interval where one or 
the other observer had scored an out-of-seat behavior. The occurrence 
reliability was S2% (i.e., number of intervals of agreement that the be7 
havior occurred divided by the nu'rt)er of Intervals of agreement* and dis- 
agreement) . 
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PROCEDURES AND RESULTS 



Figure 1 shows. the average percent of classes attended by all 12^ stu- 
dents and a sample of the rate of disruptive behavior displayed within 
one class, Tfie left ordinate provides the percentage scale for class 
attendance. Each dot connected by the solid line shows the average 
percentage of classes attended during a school day by the 12^ students. 
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Fig. I. Average percent of classes attended each day are 
shown as dots connected by' the solid lines for each of the 
four conditions of Experiment I. The percentage scale for 
attendance is shown along the left ordinate. The rate per 
hour of out-of-seat behavior for one class is shown for sev- 
en days of observation taken during the first two conditions 
of Experiment I. These rates are represented by the squares 
and the rate scale is along the right ordinate. 
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The percentage was calculated by dividing the number of classes attended 
(including excused absences) by the total number classes available (6 
times 12^), and multiplying the result by 100 to provide a percentage 
figure. The right ordinate of Figure 1 provides a scale for the rate 
per hour of out-of-seat behavior. The squares represent tKe rate of 
out-of-seat behaviors observed in the one class on seven different days^ 
of observation taken during the first two conditions of the study. 

Under the first condition there were no specific contingencies in effect 
for school attendance or disruptive behavior. An average of 63% of the 
classes were attended under this baseline condition. The rate of out-of- 
seat behavior averaged approximately 8 per hour. 

At the evening meeting prior to the second condition, the children of 
each cottage were told about a new program. They were told about a set 
of new school rules (Table 1). These rules were discussed with the chil- 
dren and they were informed that the following set of consequences would 
be in effect as of the next day: 

a^ If you go to all your classes and do not violate 

any school rules, (i.e., do not emit disruptive 

behavior) you will receive 100 bonus tokens at 
the evening meeting* 

b^You will be fined 25 tokens for each class you 
miss, (unexoused absence) 

c^You will be fined 10 tokens for each school rule 
you violate during the day. 

d^ If you miss many of your classes, you wi I I be 
placed in bed for the entire night, (bed Te- 
stviation) 

e^ If you violate a large number of rules you will 
be placed in bed for the entire night, (bed re- 
striction) 

The program was outlined and discussed with the teachers the next morn- 
ing prior to classes on the first day of this condition. The specific 
procedures of fining for rule violations were described and modeled. 
The fining for rule violations was done in the following manner. Each 
time the teacher saw a child violate a rule, she was to say the child's 
name, indicate the fine, and give a brief verbal description of the be- 
havior fined, (e.g., **Hary, ten token fine for talking without permis- 
sion;" ''John, ten token fine for not working.*') Immediately following 
this, the teacher was to put a mark ("/") on the Attendance Form by the 
child's name. Each of these marks meant a ten token fine. 
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T'\BLE 1 

A LIST OF THE SCHOOL RULES 

J 1 

1* WHEN CLASS BEGINS, YOU ARE TO BE SEATED IN YOUR CHAIR 
AND QUIET® 

2« YOU ARE TO REMAIN IN YOUR CHAIR UNLESS THE- TEACHER GIVES 
YOU PERMISSION TO t3ET UP® 

3« IF YOU WANT TO SAY SOMETHING, RAISE YOUR HAND AND WAIT 
UNTIL THE TEACHER CALLS ON YOU® 

A« YOU ARE NOT TO MAKE NOISE OR DO THINGS WHICH MIGHT BOTHER 
YOUR CLASSMATES® 

5» YOU ARE TO PARTICIPATE .N-ALL CLASS ACTIVITIES® 

6* YOU ARE NOT TO TEASE OR FIGHT WITH OTHER CHILDREN® 

7» THERE IS TO BE NO FIGHTING, YELLING, OR RUNNING IN THE 
HALLS OF THE SCHOOL® 

8* YOU ARE NOT TO DISTURB OTHFR CLASSES® * 

9» YOU ARE TO GO TO ALL "iJUR CLASSES® 

10, YOU ARE NOT TO BE IN THE^CANTEEN EXCEPT BETWEEN 'COASSES® 

1 

1U SMOKING, EATING, DRINKING, OR LISTENING TO RADIOS i°iRE NOT 
ALLOWED \¥. THE SCHOOL BUILDING^ THESE ACTIVITIES ARE PER- 
MITTED IN THE CANTEEN® 

12, YOU ARE NOT TO SAY CURSE WORDS OR TALK BACK TO TEACHERS® 

13, YOU ARE NOT TO DESTROY ANY SCHOOL PROPERTY® 



L. 



\km ALL SUPPLIES ARE TO BE PUT IN THEIR PROPER PLACE BLFOkE 
LEAVING THE ROOM® 
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At each evening meeting during the second condition the following con- 
sequences were admi ni stered r 

•a. The children who had ;one to all of their classes 
and had not received any marks for rule violations 
were called to the front of the room and were given 
^ » ^ bonus^of 100 tokens. 

•b. The names and amounts of fines were read of those - 
children who had received fines due to either class 
absences or rule violations, (Prior to the meet- 
ing, these fines had been subtracted from the chil- 
dren's bank "accounts. ) 

•c. In each cottage the two children with the lowest 
percentage of class attendance were restricted to 
their beds for the rest of the night. 

•d. In each cottage the two children with the largest 

number of fines for rule violations were restricted 
to their be'ds for the rest of the night. 

With the delayed consequences for attendance and rule violations in 
effect, the percentage of class attendance increased to an average of 
Qjt from a baseline average of 63^. The sample of rule violations, rep- 
resented by the squares, showed a decrease in the rate of out-of-seat 
behavior from an average of eight per hour under baseline to an average 
of \.k per huuT on the program of delayed consequences. This decrease 
occurred despite an increase in the average daily attendance to this 
class. That is, an average of 5^7 students attended this class under 
the baseline and an average of 9.2 attended under the second condition. 

After 19 days under this program of delayed consequences for both school 
attendance and rule violations, the conditions were changed such that 
the delayed consequences for school attendance were discontinued while 
the consequences for rule violations were maintained. At the evening 
meeting prior to this next condition, the children were told that they 
should continue to go to all their classes, but that they would not re- 
ceive any bonuses, fines, or bed restrictions for class attendance. 
They were also informed that consequences would still be in effect for 
rule violations. Thus, at the evening meeting during the third condition 
the following consequences were in effect: 

•a. The children who had not received any marks for rule 
violations were called to the front of the room and 
given a bonus of 50 tokens. 



•b. The names and the amounts of fines were read of those 
children who received fines because of rule violations. 
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• c. In each cottage the two children with the largest 
number of rule violations were restricted to their 
beds for the rest of the night. 

When the specific contingencies for class attendance were discontinued 
under this third condition for a five day period, the percentage of 
classes attended decreased to an. average of 7S%* Class attendance was 
again increased when the contingencies for class attendance were rein- 
stated under the fourth condition. Although class attendance did in- 
crease to Q]% under this fourth condition, it did not average as high 
a percentage as maintained under the second condition. However, the 
fourth condition did maintain a'higher average than during the first or 
third conditions in which no specific consequences were scheduled. 

^EKPERIUENT U 



This second experiment was conducted to provide an analysis of the ef- 
fectiveness of the program in the management of disruptive classroom 
behavior. 



METHOD 

Three weeks after the completion of Experiment I, Experiment II was 
begun. The program outlined in Experiment I remained in effect through 
out Experiment I I . 

A multif/W'baseline design across the 11 o'clock and the 1 o'clock 
art classes provided the basis for the analysis in Experiment II. 
The same teacher had both art classes. The 11 o^clock class had an 
average attendance of 10 students per day and the 1 o'clock had an 
average of 12 students per day. 



Measurement of Classroom Behavior 

A 10-second interval system was employed to measure the percentage of 
time in which one or more children violated a rule by either talking 
without permission or getting out of their seat without permission. The 
teacher's rate of social praise, tokens, and fining was also measured. 
The observers took an observation each day for 30 minutes in each class. 
The teacher's rate of praise and tokens was observed for one minute, the 
next minute the teacher^s rate of fining was observed, and the follow- 
ing minute involved the measures of the children's out-of-seat and 
talking-out behavior. Thus, over the 30 minutes, a 10-minute sample of 
the children's violation of out-of-seat behavior and talklng-out behav- 
ior was obtained. The average occurrence reliability for each measure 
was as follows: teacher rei nforcement=93^; teacher fining=98|; talking- 
out=89?; and out-of-seat=91? . 



PROCEDURES AND RESULTS 



Figure 2 presents the percentage of time "(i*e», 10-second intervals) 
in which one or nx>re children were talking wi thout. permission. This 
measure is shown in the upper graph for the 1 o'clock (PM) class and 
in the lower graph for the 11 o'clock (AM) class. The abscissa rep- 
resents the days of the study. 

During each of the first three days of this study*, the teacher spent 
approximately 5 to 10 minutes at the start of both class periocs dis- 
cussing the school rules with the children. The rules were posted on 



1PM Class 




Fig. 2. Percent of 10-second intervals in whieh one or more 
students were talking-out without permission is shown for two 
classes (PM class or I o'clock art class and AM class or 
I I o'clock art class) . 
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a big chart in the classroom such that they could be seen by the chil- 
d^^Q/„ These school rules had been in effect for nearly three months 
at the start of this second experiment. 

Under the initial condition or baseline of this study (days 1-5 of the 
PM class and days I-IO of the AM class), the teacher attempted to re- 
inforce with social praise and tokens appropriate classroom and academ- 
ic behaviors, and ignored rule violations and other inappropriate be- 
haviors. No fines were used under this baseline condition in either 
class. After five days, the teacher began fining all instances of rule 
violations In the PM class. As can be seen in Figure 2, the percentage 
of time in which one or more children were engaging in talking-out with- 
out permission deci:^ased to an average of 20% from an average of 7k% 
under the baseline condition. After another five days, the teacher be- 
gan fining all rule violations occurring in the AM class. This resulted 
in a decrease in the percentage of time in which the children were 
talking without permission. Under baseline talking-out occurf:e4^4^^ of 
the time and was decreased to 23% of the time under the treatment condi- 
tion. 

The percentage of time in which one or more children were out of their 
seats without permission was also measured. Figure 3 shows that the 
results obtained on rule violations involving out-of-seat were similar 
to those obtained for talking-out violations; however, they were not as 
clear. 

Reductions in the percent of time that children were involved in rule 
violations resulted despite the fact that teacher reinforcement remained 
approximately constant under the baseline and treatment conditions for 
each class. In the PM class, k2% of the teacher intervals observed 
under the baseline condition included the delivery of reinforcement. 
During the treatment condition for thi^s class, the teacher delivered 
reinforcement during kk% of the intervals. In the AM class, the per- 
centages were 38I and 39^ for the baseline and treatment conditions, 
res pectively . 



DISCUSSION 

The results of the present study suggest that delayed consequences can 
be effective in i ncreasi ng- class attendance and in the reduction of 
disruptive-classroom behavior. The program of delayed consequences con- 
sisted of reinforcement and punishment procedures which were differen- 
tially applied each evening based upon the children's school attendance 
and classroom behavior. These results appear consistent with previous 
research concerning the management of classroom behavior through the use 
of home-based reinforcement (Bailey et al., 1970; and McKenzie et al., 
1968). ' 



328 




4» It- 

E 



O II- 



^ f. 



AM Class 




*' f f I I y f I i — I ■ I III 'I 
1 6 Days 11 16 



Fig. J. Percent of lO-second intervals in which one or more 
students were out-of-seat without permission is shown for two 
classes. (PM class or I o^clock art class and AM class or 
1 1 o'clock art class. ) 



Although the present study Involved the delayed consequences being admin- 
istered In the children's home cottage, It Is likely that the program 
could be adapted to a normal public school. In a public school setting 
the consequences could Include reinforoing activities and materials which 
are a natural part of the setting (e.g., recess; outdoor play materials; 
access to art, gym and music classes; access to basketball practice and 
the gym over the noon hour; or an opportunity to leave school early). Be- 
cause most elementary schools use self-contained classrooms, the focus of 
the management program may not be on class attendance, but more likely on 
classroom academic and non-academic behavior.^ For example, the teachers 
of an elementary school might each carry a Reinforcement and Fine sheet 
with them at all times. The teachers would place a mark in the reinforce- 
ment column next to the student's name each time the teacher socially 
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praised a student for correct answers. Similarly, marking in the fine 
column for each school rule violation. The forms would be collected 
at a specific time during the day and the marks tallied. Those stu- 
dents with the most reinforcement marks would have access to special 
activities versus staying in a study hall, for example. 

A ff ew possible advantages of such a program over a more traditional 

token system are: 

(1) any student can be reinforced and/or fined at 
^ any time by any teacher (e.g., between classes, 

in different classrooms, on field trips); 

(2) fining a student does not require that the 
^ teacher physically interact with the student 

to take away tokens; 

(3) the calculations of the marks earned and lost 
f rom^ the reinforcement and fine form may prove 
to be nore economical in time than counting in- 
dividual student^s tokens; and 

(4) the reinforcement and fine forms may provide 
\ helpful feedback to teachers (and principals) 

to assist them in establishing and maintaining 
a high rate of social praise to their students. 

Determining the effectiveness and feasibility of such a program of de- 
layed consequences for regular elementary schools will, of course, re- 
quire much additional research attention. 
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3 SIMPLE PUNISHMENT TECHNIQUES 

FOR THE 

CONTROL OF CLASSROOM DISRUPTIONS 

thomas sajwaj; penelope culver 

Carolyn hall; /es^fe^r^^ 

The control of classroom disruptions has heen usually obtained by the 
use of a token reinforcement system, by the use of differential atten- 
tion, or by the use of some form of a time-out procedure. In a token 
reinforcement system, some type of token or point is given for desir- 
able behavior, usually of a typography incompatible with the disrup- 
tive behavior. The disruptive behavior is either ignored, punished 
with a fine (i.e., loss of tokens or points), or punished with r,he 
presentation of minus points which must be earned off to avoid some 
other form of aversive event (Broden, Hall, Dunlap and Clark, 1970). 
Similarly, the use of differential attention necessitates relatively , 
high levels of attention and praise for desirable behaviors Incompat- 
ible with the disruptive behaviors. In addition, the disruptive be- 
haviors would be ignored (Hadsen, Becker and Thomas, 1968). The use 
of time-out usually involves moving the child out of the-ciassroom sit- 
uation to a setting which is ideally less reinforcing tb the child when- 
ever he engages in the disruptive behaviors. This latter setting might 
be a barren room, the orincipaTs office, the hallway, or a chair in the 
back of the classroom itself (Zeilberger, Sampen and Sloane, 1968). 

All of these techniques have been shown *to be effective in controlling 
disruptive behaviors. However, each technique has some encumbrance in 
its utilization which will limit or eliminate its use in a given situ- 
ation. ToJ en systems necessitate some mechanics for giving tokens 
(e.g., points on pads of papers, stars on a card) with some clerical 
auditing involved. In addition, backup reinforcers need to be developed 
and time taken to purchase these reinforcers. This effort can involve 
a major restructuring and reorganization of the teacher^s classroom, an 
effort she may be unwilling to make. The use of differential attention 
by some teachers will involve a major modification of their typical 
classroom behavior. Again, some teachers' wi 1 1 be unwilling to make 
this change. .Others will not be able to make it. Also, there are some 
disruptive behaviors which cannot be ignored because of their very na- 
ture (e.g., severe aggression). Relative to„ time-out, convenient and 
practical areas to send the child may be unavailable. Some principals 
prohibit the use of their offices or of the hallways, and unused rooms 
might be nonexistent. Thus, it is quite possible that none of these 
techniques are practical in a given classroom situation. At this point, 
the teacher must have accessible other techniques which are more suit- 
able and practical for~her situation. 
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Hall, Axelrod, Foundopoulos , Shellman, Campbell and Cranston (1971) 
have provided four such simple techniques. These Involved the teach- 
er pointing her finger and saying no, the removal of a colored slip 
bearing the child's narrre, remaining after school, and after-school 
tutoring. All were effective In controlling undesirable classroom be- 
havior. More Importantly, they Involved less encumbrances to their 
usage In class than token systems, differential attention and time-out. 

The present paper presents three other types of punishment procedures 
which were effective In reducing disturbances and which involved mini- 
mal encumbrances and effort on the teacher's part. 



EXPERIMENT 1 ' 

Children 

This study was conducted In a regular third grade matK class comprised 
of twenty-four '^slow learners.*' Class met dally for one hour. The 
class, as a whole, tended to be disruptive with talk-out and out-of- 
seat behaviors being most frequent. Although the program was Imple- 
mented with, the whole class, data was obtained only on two boys, 
Albert and Harry, whom the teacher regarded as the most disruptive 
i n the class . 



Measurement and Reliability 

The teacher recorded on a slip of paper each talk-out and out-of-seat 
behavior that occurred for Albert and Harry during the last tv/enty min- 
utes of the class period. The last twenty minutes was selected be- 
cause It tended to be their worst behaved period. Talk-outs were de- 
fined as any audible verbalization without permission. Out-of-seat be- 
havior was defined as being away from the child's assigned desk without 
permission. Reliability checks were taken in each condition by having 
a volunteer take independent counts. Reliability estimates were com- 
puted by divljling the* smaller by the larger count. The range of these 
estimates was from 81% to 100%, with a mean of 31%. 



Program 

After eight days of baseline observation under the normal conditions 
of the class, the teacher initiated a five star general program for 
the entire class. Each child's name was posted on a large chart In 



Reprints may be obtained from the first author at the Department 
of Psychiatry, University of Mississippi Medical Cejiter, Jackson, Mis- 
sissippi 39216, Experiments I and II were partially supported by The 
Avery Fund for Research in The Behavioral Sciences, 
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the front of the class. If he did not talk-out or was not out-of-seat 
beyond a minimum number per class period, he received a star by his 
name on the chart. This minimum number was varied from one to three. 
When a child accumulated five such gold stars, he was awarded a five 
star general badge to wear for one day. This badge was a simple small 
bow of red, white, and blue ribbon with a golden metal button, which 
was worn on^the shirt or blouse. When a child wore this badge, the 
other children were told to honor the wearer by saluting him whenever 
they passed him In school. This salute consisted of a raised right 
hand with the thumb and middle finger touching and forming a circle. 
When a child Had earned a badge on two occasions, he was awarded a 
special letter of commendation by the teacher which he was to show to 
his homeroom teacher, the principal, and his parents. This commenda- 
tion stated In flowery, script and In formal language that the child 
had been excelling In good citizenship la his math class. After eight 
days of this program, baseline conditions were recovered for an addi- 
tional eight days. The program was then reinstated. 

BASELINE PROGRAM BASELINE PIR06RAM 




DAYS 

Fig. 1/ Number of talk-outs and out-of-s^at episodes in 
twenty minutes' for Albert and Harry in Experiment I as a 
function of baseline conditions (no systematic program) 
and of golden star and general badges for minimal disrup- 
tive behaviors (program). 
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Results 

Figure 1 shows the rate of talk-out and out-of-seat behaviors per twen- 
ty minutes for Albert and Harry. During th^ initial baseline condi- 
tion, Albert and Harry each talked about ten to fifteen times per twen- 
ty minutes and were out-of-seat between five and ten times. During the 
initial use of the five star general program, talk-out and out-of-seat 
behavior dropped to virtually zero. ,The return to baseline conditions 
prompted an increase in both behaviors In both boys. The reinstatement 
of the program recovered the very low rates of these disruptive behav- 
iors. Subjectively, the teacher reported th^^t the program was as ef- 
fective with the other children in the class. The class atmosphere im- 
proved, and the children became more productive. 



EXPERIMENT I I 

Childrjsn 

A fifth grade class comprised of twenty-four children of average intel- 
ligence attended a one hour class. Data on poor sitting posture (slouch- 
ing) were collected on the entire class. In addition, talk-out data 
were obtained on one-boy, Charles, because the teacher felt that he had 
the highest level of disruptive behavior in the class. 



Measurement and Reliability 

For slouching, the teacher made four checks during the class at ten 
minute intervals. The number of children not sitting correctly was re* 
corded each time. At the end of the class, an average of these four 
checks *was computed, bitting erect with feet flat on the floor in front 
of the desk and with both arms on the desk top was considered proper sit- 
ting posture. Any deviation from this was considered slouching behavior. 
Students who were outrof-thei r-seats for any reason or who were leaning 
down to get books oat of their d^ks were not counted as slouching. 
Charles* talk-outs were tallied during a 20-minute period by the teacher 
marking on a slip of paper. A talk-out was defined as any audible talk- 
ing sound made without permission. Reliability cnecks were made on both 
categories of behavior in each condition of the study by having an inde- 
pendent observer record these behaviors. 

Reliability estimates were computed by dividing the smaller score by the 
larger score. For slouching behavior, these estimates ranged from S7% 
to 100^, with a mean of 32%. For talk-outs, the range was from 86^ to 
100^ with a mean of 36%. 
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Program 

BASELINE observations were made for five days under typical olassroom 
conditions. LOSS I conditions were then implemented. The children 
were paired according to roygh subjective estimates of their disruptive 
behavior, with the two best together, two worst together, etc. Each 
child was given 100 points at the start of each class period. Each 
time a child talked-out or slouched, one point was subtracted from his 
total. Running totals were conspicuously displayed at the front of the 
class. Toward the end of the class period, the child in each pair wi^th,,, 
the most points was allowed ten minutes of free time to do as he pleased 
The loser i.n each pair was given more classwork for that ten minutes. 
The LOSS II condition was identical with the LOSS I condin:ion except 
that free time was not awarded to winners. Instead, winners in each 
pair were only announced at the end of each class period and attention 
drawn to their accomplishment. This was done to allow a comparison. of 
the effects of public display and competition with the_effects of the 
free time pri vi lege. 

LOSS I, LOSS II, and BASELINE conditions were then alternated to isolate 
the effect of each type of condition. 



Results 

Figure 2 gives the daily rates of slouching behavior for the whole class 
and of talk-outs per twenty minutes for Charles. During BASELINE condi- 
tions,, rates of both, behaviors were relatively high. About ten or more 
children {kO% plus) would be slouching at any one ttme. Charles' talk- 
outs were above ten for the 20-minute period. During LOSS I conditions 
(public display and competition, with free tim^T privilege), rates of 
both behaviors were virtually zero. However, during LOSS II conditions 
(public display and competition alone) slouching rate would initially 
be low but would then slc3wly increase. This slow increase occurred^on 
all three exposures of the class to the public display and competition 
factors alone. Charles' talk-out rate during LOSS H conditions was 
roughly intermediate between BASELINE and LOSS I conditions. 

It is clear that public display and competition did reduce slouching and 
talk-outs, at least, temporarily. However, maximal reductions were ob- 
tained by the inclusion of the free time reinforcer with public dispfay 
and competition. It would appear that the free time privilege is the 
more potent factor. This cannot be asserted unequivocally since the 
free time privilege was not presented alone to determine its effective- 
ness independent of public display and competition. 
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BASCLINE LOSS X LOSS E BASEUNE LOSS It ^ LOSS S LOSS X 





DAYS 



Fig. 2. Average number of children slouching 
at any time and Charles' talk-outs per twenty 
minutes in Experiment II as a function of un- 
tre^4^e^BASELINE) conditions, public display 
and competition with free time privileges 
(LOSS I), and public display and competition 
alone (LOSS ID- 
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EXPERIMENT 111^ 



Child 

Mark was a six year„old, retarded child with a history of convulsions, 
vision difficulties, tantrums, and enuresis. The convulsions were con- 
trolled by medication. His speech, social behavior, and play behavior 
were poorly developed for his age. He could not participate in the 
regular or special education programs of the public schools. Instead, 
he was piaced in an experimental preschool for retarded and/or emotion- 
ally disturbed children. 

DjLLrJmg the course of his participation in this program, a serious throiv'- 
ihg problem developed, tiark would throw large objects, usually toys, 
across the classroom. This throwing was rarely aimed at anyone, but 
there was a real dainger to the* other children and to the teacher. 



MeasiiPen.^.nt and Reliability 

An observer recorded the frequency of Mark's throwing by checking off 
each ten second interval in which any throwing occurred (Allen, Hart, 
Bual 1 , Harris and Wolf, 1964). Throwing was det -^-d as picking up any 
object with his hands and throwi ng^ it so that i 1: anded more than one 
foot away from him. Mark's throwing was recorded for twenty minutes 
during free play each morning. 

Reliability checks were made Hy having an independent observer record 
throv.ing behavior with the regular observer on fourteen occasions dur- 
ing the first two conditions of the study. Reliability estimates were 
obtained by comparing each interval and counting an agreement if both 
observers scored throwing. If only one observer scored throwing, a 
disagreement was scored. If neither scored_throwi ng , neither aji agree* 
ment nor disagreement was score'. The number of agreements was then di- 
vided by the sum of the agreements plus disagreements. These ranged 
from S7% to 1001, with a mean of 31%. The lower estimates were obtained 
in the reprimand condition. However, all observers in this condition 
agreed that overall rate of throwing was reduced sharoly. 



\ 

2 
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Frogmm 

During BASELINE conditions, throwing was ignored. However, the teach- 
er made efforts to keep the other children out of the range and direc- 
tion of his throwing. During REPRIMAND condi tions the teacher would 
immediately come over to Mark after each episode of throwing. She 
would grab his shoulders, look him straight in the face, and sternly 
say, "Mark, I don't want you to do thatl'* She then released him and 
returned to her duties. This REPRIMAND, procedure took about three to 
four seconds. After the first few- reprimands , Mark began shaking his 
- shoulders In an apparent effort to make the teacher release her grip 
on his shoulders. The teacher was then instructed to keep her grip 
until he clearly stopped shaking. She h->d to hold him for as. long as 
15 seconds, but the shaking disappeared rapidly. After fourteen days 
of this REPRIMAND procedure, BASELInE conditions were restored where 
throwing was ignored. After this condition, the REPRIMAND procedure 
was reinstated for three days.^ark was then terminated from the pre- 
school because of very poor toi-let training. 




FREEPLAY PERK)DS 



Fig. 3. Percentage of throwing intervals in Exper- 
iment I 1 1* as a function of ignoring (BASELINE) and 
REPRIMAND. 
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Results 

D Ing BASELINE conditions, throwing occurred in about 1Q% to 30^ of 
tie free play period. During the initial REPRIMAND condition, throw- 
ing rate slowly fell to zero. More strikingly, the throwing of large 
objects (e.g., large woodeh blocks) disappeared very rapidly during 
the first three to five days of the REPRIMAND condition. In addition, 
tlie distance of throws fell rapTJly-, — Consequently, during the latter 
part of the first REPRIMAND condition he was throwing only small ob- 
jects (e.g^, tinker toy sticks) for only about one to two feet, where- 
as during the BASELINE conditions he threw large objects across the 
classroom.. This effectiveness was recovered during the abbreviated 
second REPRIMAND condition. 



CONCLUSIONS AND DISCUSSION " 

These experiments demonstrate thre^ simple punishment techniques to 
be effective in controlling classrbom disturbances. In Experiment I, 
disruptions beyond a given minimal number were punished with the loss 
of a gold star with the consequent loss or delay in earning the five 
star general badge and Its' accompanying attention and prestige. In 
Experiment II, slouching and talk-outs were punished by the loss of 
points. Losing more points than one*s competitive par tner^resul ted 
In doing ten more minutes of academic work. In Experiment III, the 
social reprimand with the mild restraint of holding was effective in 
reducing dangerous' throwi ng. More^lmportantly , each of these three" 
techniques was simple and practical to use. Backup rei-nforcers and 
clerical auditing, as needed in a token system,, were minimized. A 
high level of attention for desirable behavior, as needed in a differ- 
ential attention procedure, was unnecessary. The need for facilities 
outside the classroom, as often needed with a time-out procedure, was 
very minimal. Thus, a high level of effectiveness in the control of 
classroom disruptions was obtained at a relatively low response cost 
' to TReTeacher. Such an increased efficiency is obviously conducive 
to the increased usage of punishment techniques and behavior modifica- 
tion procedures, in general, in educational pi'actice. 

The procedures In Experiment I are similar to those used- by Osborne 
(1969). He withdrew free time from academic v/ork for any occurrence 
of out-of-seat behavior in deaf children. Experiment I set a maximal 
number of disturbances after which the opportunity to obtain a gold 
star was lost. This, in turn, delayed the opportunity to earn the five 
star general badge and the accompanying system of attention and pres- 
tige. The major difference between these two procedures is the nature 
of the relnforcer lost. 

•The procedures of Experiment II are similar to several techniques used 
previously. Most similar is the Good Behavior Game (Barrish, Saunders 
and Wolf, 1969)- Their class was divided into two teams. Marks were 



to 



given for each occurrence of out-of-seat and talk-out behavior. The 
team with the fewest marks earned several classroom privileges .(e.g., 
free time). In Experiment II points were lost, while they werfe given 
by Barrish et al., an apparently trivial procedural difference. Ex- 
periment II suggests, more importantly, that the public display and 
competition v/ere relatively less important than the gain of the class- 
room privileges. However, Barrish et al. used large groups competing 
against each other, whereas Experiment II used individuals. It may 
very well be that competition and peer pressures were more relevant 
factors in the Barrish et al. form of The Good Behavior Game. 

The simple, yet effective reprimand of Experiment III is similar to 
the pointed finger and no reported by Hall et al. (1971) which was 
highly effective in reducing biting and pinching in a deaf girl. 
Also, O'Leeiry, Kaufman, Kass and Drabman (1970) found soft reprimands 
to be effective in reducing classroom disruptions. The prime advan- 
tage of a reprimand procedure is its utter simplicity. It is the 
simplest and least encumbered procedure of all those cited in this 
paper. However, reprimands and commands do not always function as 
punishers. Thomas, Bec^^r and Armstrong (1968) have found these to 
help maintain undesirable behavior. 

i 

These three simple experiments, together with those studies cited 
above, suggest that there is a wide range of very flexible procedures 
which can be used to control classroom disruptions. One does not have 
to institute a token economy or to utilize a time-out area to maintain 
order in a class. Further, efficiency may be improved since these 
techniques, generally have fewer encumbrances than tokert economies and 
time-out procedures. 

Finally., it should be. noted that techniques such as The Good Behavior 
Game are very difficult to-classify as a positive reinforcement or 
punishment procedure. They inherently seem to be both, so that a sep- 
aration of reinforcing and punishing functions is impossible. 
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Using 

reinforcement contingencies & teaching aids 
to alter subtraction performance of 
children with learning disabilities^ 

tieborah d. smith 
torn c. lovitt 
John d. kkUer 

The procedures used bv teachers to change the 
mathematics behavioi^s of puoils are either con- 
tingently or non-contingent I y associated with 
the responses of children. Two projects are 
described in this report. Both deal with the 
subtraction performance pf learning disabled"! 
children. The pupil in PROJECT I was eleven; 
the student in PROJECT II was ten. 

In the first project a contingency was sched- 
uled that positively influenced subtraction 
performance. During certain phases, a with- 
draw of reinforcement contingency was imposed — 
minutes of recess time were taken away contin- 
gent on incorrect answers. A multiple baseline 
design was used. 

^, , . , ^ the second project a series of non-contin- 

gent events_al tered subtraction performance. 
During some condi tibns of the study tradition- 
aMy used teaching aids — paver alip&y abacus^ 
auisinave rods — were used by the pupi I to as- 
sist in comput'ing subtraction facts. In PRO- 
JECT II a series of *A8A designs was used. 



When a pupil Is not responding correctly or efficiently to academic ma- 
terials, the teacher must select a remediation tactic. Broadly speak- 
ing, two remediation strategies are avai lable--teachlng routines and 
contingency management procedures. 

Teaching routines are arranged by teachers on a non-contingent basis. 
They are scheduled to occur regardless of the quality or rate of the 
pupITs responding. Instructions, for example, were used effectively 
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by Lovitt and Smith (1972) to increase the verbal output of a child. 
Lovitt and Curtiss (1968) showed that a tactic such as verbalizing 
mathematics problems before responding increased accuracy. In both 
studies the teaching routine was non-cont i ngent ly programmed. Model- 
ing and cuing are other instructional techniques scheduled on a non- 
contingent basis. Many teaching aids such as cuisinare rodsy number 
tines y and the abacus are scheduled non-cont i ngent ly. 

By contrast, reinforcement procedures are arranged on a contingent 
basis. The prescribed circumstance will occur only if the pupil be- 
haves in a certain way. Reinforcement procedures have been used to 
attenuate certain behaviors as exemplified in a study by Becker, Mad- 
_-^en, Arnold and Thomas (1967), when they successfully reduced class- 
room behavior problems. Reinforcement contingencies have also been 
used increase certain behaviors. For *»xample, Staats and Butter- 
field (1965) demonstrated that certain reading behaviors could be ac- 
celerated 

The variations in which contingencies can be arranged are many. In 
academic areas, for example, where correct and incorrect answers are 
generally tallied, a contingency could be associated with correct an- 
swers, incorrect answers, or both. The ratio of such a contingency 
has infinite variations. The reward or consequence used could range 
from praise or candy to a special privilege or free time. 

Although more behavioral research has been conducted to study the ef- 
fects of contingency management procedures than teaching routines, 
teachers are generally more apt to employ the latter method than the 
former. Some teachers probably use 25 teaching routines' for each con- 
tingency they arrange. Most teachers, in their response to a pupiTs 
academic failure, initially select a teaching routine to alter perform- 
ance; if that event proves ineffective, they select a different one, 
I f the child, for instance, can't solve the problems in one text, a 
model is provided, cuing is offered, flash cards are used, anumber 
U ne is provided, 

Quixotic searches for perfect teaching procedures could require months 
before the perfect match is found. Other approaches are required to 
assist some students; for many pupils could perform the behavior re- 
quested by the teacher, but ar.e unwilling. Some pupils are more rein- 
forced by staring out windows than completing their math assignments. 
Others seem to enjoy playing games with their teachers. Still other 
pupils see no point in doing their math, V/ith children who actively 
resist Instruction, teachers could alter non-contingent routines until 
dooms day to no avaiK 

Conversely, is the rare teacher who has an affinity for -uti 1 izi ng con- 
tingencies to aid in effecting the academic proficiencies of her pupils. 
This teacher believes that anything can be taught if only the effective 
reinforcer can be found and contingently arranged with the desired be- 
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havior. As her counterpart impetuously searches for the Ideal teach- 
ing routine, so the contingency prone teacher chases the elusive mo- 
tivator. Such a teacher, attempting to Instruct a child to subtract 
might Initially arrange a setting that provides the pupil with one 
minute of play time for each ten correct answers. If that failed, the 
ratio might be reduced. If those changes also failed to stimulate cor- 
rect responding, the consequence Itself might be altered from music to 
television, to praise, to candy. It could be, however, that the child 
has no part of the required behavior In his repertory. In such a-case, 
the manager could arrange countless contingencies without affecting the 
pupl 1 ' s behavior. 

Certainly, In the first Instance v/here the child could perform the de- 
sired behavior but wouldn't, some reinforcement contingency should have 
been arranged, rather than switching from one teaching procedure to an- 
other. Likewise, In the second example where the child could not per- 
form the desired behavior and didn't, a teaching routine should have 
been set up rather than trying to alter behavior with contingency man- 
agement. 

Following are two projects; both are concerned with Increasing subtrac- 
tion proficiency In children. The first project demonstrates how, un- 
der certain conditions, contingency management procedures can effective- 
ly Influence a pupil's responding. By contrast, the second project il- 
lustrates how, undervdl f ferent circumstances, teaching routines. In the 
form of i nstructional a^^ds , can positively alter accuracy. 

^PROJECT I 
METHOD 



Subject and Setting 

The student in this study was an eleven-year-old girl, Susie, referred 
to the Experimental Education Unit (EEU) , University of Washington, be- 
cause of reading difficulties. For the purposes of another experiment, 
Susie was given two achievement tests at the beginning of the school 
year, the Wide Range Achievement Test (WRAT) (Jastak, Bijou and Jastak, 
1965), and the Metropolitan Achievement Test (MAT) (1965). .On the WRAT 
Susie scored k.k In reading, 4.5 in spelling, and 4.7 in arithmetic. 
On the MAT (Elementary Battery) she scored 4.0 In word knowledge, 4.0 
in word discrimination, 2.4 in reading, 4.0 in spelling, 4.0 in lan- 
guage, 4.0 In arithmetic computation, and 3.7 in arithmetic problem 
solving. 

Susie was a student in the curriculum research classroom. In this 
class were six chi Idren, ages 8-12. Three of the children were referred 
from special classes, three from regular. The class was directed by two 
full-time teachers. 

ERLC 
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Materials 

Three classes of subtraction problems were used throughout the project. 
Class l-(CI) problems were the borrow facts where the top numerals or 
the minuends ranged from 10 to 19, the bottom numerals or the subtra- 
hends ranged from 0 to 9; the remainders ranged from I to 9- There 
were ^5 different problems in this class. Class 2 (C2) problems dif- 
fered in that the minuends v^ere from 20 to 98. The subtrahends were 
single digits , I through 9, and the remainders ranged from II to 89. 
In all of these problems, regrouping or borrowing was required. There 
are 360 problems in this class. For the Class 3 (C3) problems the min- 
uends ranged from 20 to 98. The subtrahends ranged from II to 69; where- 
as the remainders were from II to'79. Regrouping was always required. 
There wer^ 1260 different problems in this class. 

From each class of^roblems five different sheets were constructed. For 
the CI set some problems were used on more than one sheet since there 
were only ^5 problems in the class. The problems were randomly assigned 
to the sheet and no problem appeared more than once on any sheet. For 
02 and C3 different problems were placed on the five sheets \u each 
class; no problem was used more than once. First, the 125 problems of 
each class were randomly selected from the total number of problems in 
each class. Then those problems were randomly assigned to one of the 
five dai ly sheets. 



Design 

The design of this study was a multiple baseline. Six phases* comprised 
the study. During the first phase no contingencies were in in effect. 
Following this baseline, a withdraw contingency (withdraw of positive 
reinforcement) was successively scheduled on ^dch sheet. This contin- 
gency, which specified that for each I ncor-rect-answer one minute of re- 
cess time would be lost, Was arranged first on CI. Then, after five 
days, it was also placed on C2. After another ten days the contingency 
was additionally placed on C3. The contingency remained in effect for 
all three sheets for another twelve days. 

The contingency v/as first removed from the C2? sheet. After three days, 
the contingency was removed from the CI sheet. During the final phase 
the contingency was in effect for only the C3 sheet. Since the quarter 
ended, no time was left to schedule a condition where the contingency 
was removed from that sheet. 



Procedures 

Each day the pupil was given three sheets of subtraction problems. 
Each sheet contained 25 problems of a different class. On successive 
days a different arrangement for each class of problems was used. The 
order in which the sheets were given the pupil varied from day to day. 
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The pupil was requested to complete each page. Following the completion 
of the three pages, they were collected by the manager who checked the 
answers, counted the number of correct and Incorrect responses, calcu* 
lated the rate and percentage scores, then plotted the data. 

Throughout this study the manager used scoring sheets to record Infor- 
mation regarding each session. On these sheets, one for each class of 
problems, were recorded the day of the session, the date, number of cor- 
rect and Incorrect answers, time required to complete each sheet, cor- 
rect and error rates, and the percentage correct score. Since. each 
sheet contained 25 problems, each problem was worth k%. 

After the study was completed, all th-e darly papers were rechecked to 
ensure that the girPs responses were accurately graded. Each entry on 
the scoring sheets was also re-examined. The data appearing on the 
graphs were based on the rechecks. 

, Throughout the study the pupil was given no feedback as to which prob- 
lems were Incorrect. The reason no feedback was given and that no 
teaching was provided was that the manager had observed, on occasions 
prior to this study, that the pupil could perform the CI and C2 prob- 
lems. The manager did not, however, know what to expect when Susie 
worked the C3 problems. 

During the phases when loss of recess time was scheduled for errors, 
she was simply told how many problems were Incorrectly answered, and 
how much recess time she lost. Also, during these conditions, she was 
told the sheet(s) where the contingency applied. She was not told, 
however, when the contingency was removed. 

RESULTS 

The data from the three sheets; CI (see Figure 1), C2 (see Figure 2), 
and C3 (see Figure 3) will be discussed by phases. 



Phase' 1 : Baseline 

During the baseline phase Sus\Le*s performance was very poor on all prob- 
lems. On the CI problems only one 100% day was noted; none were re- 
corded for the 02 problems^ On four of the five days on the C3 problems 
her scores were 0%. 
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Fig, L Percent correct for CI 
type subtraction problems through- 
out PROJECT L Only successive- 
data days are connected by I i nes^> 
The spaces between data days are 
accounted for by absences, week- 
ends , or hoi idays. 
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Fig. 2. Percent correct for C2 
type subfraction problems through- 
out PROJECT L 
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Fig. 3. Percent correct for C3 
type subtraction problems through- 
out PROJECT L The arrow on the 
first day of Phase 3 indicates 
that she got the first three prdb^ 
I ems correct, but erred on all the 
rest that day. 
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Phase 2: Loss of Recess Time for CI Errors 



When the contingency of one minute taken from recess for each problem 
missed was placed on the CI problems, the pupil's performance was im- 
mediately affected* Her score on the CI problems rose from a mean of 
60% in the baseline condition to a mean of 93.6% in Phase 2. Susie's 
performaTice on the C2 problems was positively affected only on the 
first day of Phase 2 as indicated by the arrow on Figure 2. After that, 
she again did poorly on those problems. On the C3 problems her accura- 
cy continued to be quite poor. 

Phase 3: Loss of Recess Time for CI and C2 Errors 

In the thi.rd condition the withdraw contingency was still In effect for 
the CI problems. She continued to maintain a high percentage score 
(mean = S8%) for those Items. During this phase the contingency was al- 
so arranged for the C2 problems. Her perforniance on those items was im- 
mediately and positively Influenced. On the C2 items her mean percent 
score in Phase 2 was 16.8%; in the third condition, it rose to a mean 
of 97.2%. On the first day of this phase, she showed some improvement 
on the C3 problems as pointed out by the arrow on Figure 3. On that day 
the first three problems on that page were done correctly. This indi- 
cated for the first time that she could do at least some of the problems 
in that class. After the first day, however, her percent score remained 
at zero. 



Phase 4: Loss of Recess Time for Cl^ C2^ and C3 Errors 

During this condition the withdraw contingency was in effect for all 
the problems. On the CI problems Susie maintained a high mean of 99.3%. 
Her scores on the C2 problems also remained high, with a mean of 97.3%. 
Susie showed the same dramatic Improvement on the C3 problems that she 
had on the two previous classes once the error contingency was applied. 
Her percent correct score rose from 1.2% in the previous condition to 
97.6% in this phase. 



Phase 5: Loss pf Recess Time for CI and C3 Errors 

The contingency was still in effect for Cl and C3 problems but removed 
from C2. Susie malntain4a"a*mean of 100% on the Cl problems and 97.3% 
on C3. She had a mean of 100% on the C2 problems even without the con- 
tingency in effect ♦ 
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Phase 6: Loss of Recess Time fop-VS Errors 

The experimenters now removed the contingency from the CI problems. 
She maintained ]00% on this class as well as on the C2 problems. Her 
scores on the C3 problems rose to an average of 100%. 



DISCUSSION 

When the withdraw contingency was imposed first on CI, then C2, then 
C3, the effects were immediate. When placed on CI In the second con- 
dition, her percent score rose from a ZQ% score on the last session of 
the preceding phase to a 32% score on the first day of the withdraw 
condition. Similarly, her performance on C2, when the contingency was 
scheduled, rose from 0% to 100%, and on C3 from 0% to 96%. 

These prompt changes, hc^ever, were noted on only the sheet where the 
contingency was scheduled, generalizations to the other sheets did not 
occur.- In Phase 2 when CI performance was influenced, the pupi Ts 
scores on C2 and C3 remained as low as they had been during the base- 
line. When the contingency was arranged for CI and C2 in Phase 3, her 
performance on C3 continued to be poor. 

A further observation, based on these data, was that performance on CI 
and C2 continued at a high level when the withdraw contingency was re- 
moved. Thus, generalization of another type had occurred; when the 
treatment was removed, performance continued to be satisfactory. ' 

^PROJECT II 

The same classes of subtraction problems used in PROJECT I were used 
in this project. PROJECT II, however, differs from the first, both in 
design and tactic. The design of this project followed an ABA format; 
whereas the firut project utilized a multiple baseline design. Instead 
of using contingencies to increase academi c ^performance, teaching rou- 
tines were employed in this project. 

Beyond the primary purposes of this project--to study the effective- 
ness of some commonly used instructional aids — a secondary purpose was 
to obtain data about within and across response class generalizations. 



METHOD 

Subject and Setting 

The subject of this study was a 10-year-old boy, Greg, referred to the 
EEU from a local special education class because of academic deficien- 
cies. Greg was a member of the same class as Susie, the subject in 
PROJECT I. 
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When he entered the class, Greg was given two achievement tests. On 
the MAT (Elementary Battery) the following scores were obtained: 
2.2 In word knowledge, 2.k In word discrimination, 2,6 In reading, 

2.2 In spelling, 1.2 in language, 3.0 In arithmetic computation and 

2.3 in arithmetic problem solving concepts. On the WRAT, the child 
scored 2.5 In reading, 1.6 In spelling and 2.8 In arithmetic. 



Materials 

Greg received the same classes of problems used In the first project, 
but instead of computing one page of ^^roblems per class, he received 
two pages per class. 

For eacH class, different problems were randomly assigned to one sub- 
class or the other (I.e., Cla and Cld). Five different sheets for 
each subclass were devised. Ji^e order of presentation was the same 
as that described earlier. 



Table 1 shows the total number of problems in each class and the num- 
ber actually used in each subclass. Also indicated, is how the prob- 
lems, were distributed on the five sheets. 



-miEr 1" 



OHGAIJIZATION OF SUBTRACTION PROB- 
LE4S IN PROJECT II. 



CLASS TOTAL SUBCLASS USED 5 SHEETS 

n O o o OOOOOOO^OOQOnnnrtn^nnnnr;ia,-,r,i-.OaO 0^ 

a ■ 45 Cla 23 ^ Uodi^Ud 

Clb 



22 A/uiangm&nt. 

20 poA ShaeX' 



C2 360 C2a US UUtfiZivt 

T%obtem 



C2b US 



25 pvi Sh&eX 



C3 1260 C3a 125 dlii(LA.e.ivt 

r,2u toe PflobtiM) 

25 P2A SluU 
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Design 

The. experimental strategy was, f i rst ,.obtai n baseline measurement from 
five sheets (Cla, Clfe, -C2a, C2fe, da); then schedule a teaching aid with 
one sheet of the class curre,iliy being taught (e.g., Cla). Since one 
purpose was to measure within cjjiss^^generalization, the aid was not as- 
sociated with the other sheet of the same class, (e.g., Clfe). Another 
purpose was to obtain measurements of the ''next'* response class, to de- 
termine the extent of across class generalization (e.g., 2a and 2b). 

Once criteria was reached on the sheet where the teaching aid was used, 
the aid would be re x^'ed. to determine if performance continued at a 
satisfactory level, if performance maintained, the next step was to 
focus attention on the. next class of problems (e-g., C2a) . For that 
clas.. a different teaching aid would be used. 

Another aspect of the strategv was that after criteria on a class of 
problems was reached and in^ructlon was shifted to a different class, 
measurement would continue to be gathered periodically on the former 
class of problems. so doing,' the experimenters would obtain data 
about retention and would be able to refocus teaching on those prob- 
^lems if the pupiTs performance worsened. 

*lt is important to remember that throughout this project the a sheets 
were those on which teaching was focused. The b sheets were the com- 
panion problems in each class; no teaching was^-di rected toward them. 

Procedures ^ 

Each day during the eleven conditions of this study, Greg was requested 
to complete each page of mathematics problems presented to him. When 
the student completed the sheets, the manager corrected each one, count- 
ed the number of correct and incorrect answers, calculated rate and per- 
centage scores, then entered these on the scoring sheets and plotted the 
data. After the completion of the project, all the math sheets and thie 
scoring sheets were rechecked. The data presented here were based on 
those rechecks. 

% 

PHASE I: NO INSTRUCTION AIDS. 

During the baseline condition ro instructions, confirmation, 
or contingencies were schedulpj. Measurements were obtained 
for all sheets except C3i>, which was introduced later. 

r ' - 

^ PHASE 2: PAPER CLIPS FOR Cla. 

Throughout the second condition the pupil was given OS paper 
clips. Each day prior to the boy^s working the Cla problems, 
the manager handed him the clips and gave him one example. 
Greg was shown how, if the problem was 18 - 9 » D , to take 



9 clips away from the pile, then count the remainder which 
was the answer. A 

PHASE 3: REMOVAL OF PAPER CLIPS _FROM Cla. 

During this condition, the paper clips were removed from the 
Cla problems. Greg received no instruction on any of the 
math problems in-this phase. 

»i " — ^ 

PHASE 4: "TRAGUS FOR C2a. ' • 

in this condi tiony'^Greg was provided with an abacus as he 
worked the C2a problems. Each day during this phase the man- 
ager worked one problem for him. 

PHASE 5: ^REMOVAL OF ABACUS FROM C2a. 

The abacus was removed from the Cla problems. Greg received 
no instruction on any of the math pages during this phase. 

PHASE 6: INSTRUCTIONS FOR Cla. 

Attention was refocused on Cla because the boy's accuracy began 
to decline during the previous condition. Each day before Greg 
worked the Cla problems, i hs true t ions- were provided. First, 
the manager wrote put a problem like 18 - 9 = □, then' asked 
the pupil to say the answer. If he answered correctly, the man- 
ager said **gbod;" If not, she told him the answer. Second, Greg 
was asked. If he needed to cross out anything (to regroup)^^. If 
he answered correctly, Jthe manager said **good.** If he said that 
.borrowing was required. It was explained why it was not neces- 
sary. 

PHASE 7: REMOVAL OF INSTRUCTIONS FROM Cla. ; 

Instructions were no longer given to the child for Cla^dtTring 
this phase. Greg received no instruction on any of the math 
problems during this phase. Measurement of his performance 
on the C3b problems began in this condition. 

I?HASE 8: CUISINARE RODS FOR C3a. 

louring thi s condi tlon Instruction was directed toward th'^ C3a 
problems. Throughout this phase as. the boy worked on the C3a 
problems, he was given a set of cuisinare rods to use. He 
was J nstructed in the use of the rods and given one example 
each day. 

PHASE 9: REMOVAL OF CUISIMARE RODS FROM C3a; ABACUS .PROVIDED 
- FOR C2a. . " * 

The cuisinare- rods were not as effective as the paper clips or 
abacus. Also, during the eighth condi tlon,**Greg*s accuracy on 
the C2a problems began to lapse. Attention, was, therefore. 
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refocused on that class* During Phase 9 the abacus was again 
provided Greg as he worked the C2a problems. 

PHASE 10: REMOVAL OF ABACUS FROM C2a- 

The abacus was withdrawn from C2a in this phase. During this 
condition Greg received no Instruction on any of the math 
problems. Greg did not, however, maintain a high level of 
accuracy-; 

PHASE II: INSTRUCTMON FOR C2a. 

In the final phase, the focus was again on C2a. Now, instruc- 
tions and an example were provided daily, prior to his answer- 
ing those maabl ems . First, the manager wrote^ out a problem 
of the tyjJeZA - 6 = Q. Secwid, she asked the pupil to solve 
it\ If he was successful, "stie^said, "good;'* if not, the prob- 
lem was computed for him. Third, the pupil was asked to ex- 
plain the regrouping process (cross out 2, replace it with 1, 
place 1 by A) . If he could comply, the manager said, "good;" 
if not, the steps were explained. 

Further conditions v;ould have been run, but the school term 
ended. 



RESULTS 

Results for the classes and subclasses of PROJECT II will be discussed 
by phases. Graphs are included for Cla and C]b (see Figure A), C2a 
and C2b (see Figure 5) and C3d and C3b (see Figure 6). 



Fig. 4. Percent correct for 
Cla and Clb type subtraction 
problems throughout PROJECT II. 
Since the pupil's performance 
was extremely accurate during 
Phase 1, only review days were 
scheduled in Phase 8. No data 
were obtained tnroughout the 
final three conditions. 
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Fig. 5. Percent correct for 
C2a and C2b type subtraction 
problems throughout PROJECT I 
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Fig. 6. Perdent- correct for 
C3a and C3b^^pe subtraction 
problems throughout PROJECT II 
No data were o]),tained on the 
C3b problems until the latter 
^part of Phase 7 because the 
pupil errad on- every problem 
on the C3a sheets. 
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During the baseline condition when Greg received no instructions or 
any other interventions on the mathematics sheets, percent correct 
scores were zero on all five sheets. It is important to note that 
many of PauPs errors were not random. He used a faulty rule that ac- 
counted for many of his errors. He subtracted the smaller number in 
the units column from the larger number. His answer » for example, tc 
the problem 18 - 9 =□ would be 1 . 

■ 

fhas^^ 2: Paper. Clips fop Cla 

When the paper clips were provided for Cla, his performance on those 
problems improved greatly (x = 96.7%). His performance was also ex- 
cellent on the C15 problems; within class generalization had occurred. 
Meanwhile, on the C2a problems, his performance improved slightly from 
a niecm-oLOI^Mx^^Jja^ phase, to a mean of 15.7% in Phase 2. 

His scores' ranged frVm'^l to72|. fiOn Z2b he obtained a mean of 16%. 
Across* class generalization was very minimal. His mean on C3a was zero. 
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Phase 3: Removal of Paper Clips from Cla 

Although the paper clips were no longer provided for Cla, his perform- 
ance continued to be excellent on that class with a mean of 33. S% for 
Cla and 98 • 7^ for Cli?, His scores on C2a declined from the previous 
phase. On 8 of 14 days his percentage scores were 0^, On C22? his 
scores ranged from 8^ to 16^, a mean of 12.6^, Al ! scores on C3a in 
this condition continued to be zero. 

Phase 4: Abacus for C2a 

In this condition an abacus was provided Greg as he worked on the C2a 
problems. His scores on those problems were all 100^, On the compan- 
ion sheet, C2b, his scores were generally perfect (x = 98,5%). Within 
class generalization again had occurred. C3a scores were all zero; 
again across class generalization had not occurred. His average scores 
on the^^la and C12? problems throughout this phase continued to be 100%, 

Phar^e 5: Removal of Abacus from C2a 

The abacus was now removed from the, C2a problems, * During this time his 
accuracy on the C2a problems maintained. On 5 of th6 8 days his scores 
were 100%, His accuracy, however, on the Cla problems i)egan to worsen. 
On the two da/s during this phase that his performance was measured on 
Cla, his scores were 95% and 80%. On Ob the scores were 95% and 100%, 
All C3a scores were zero, - 



Phase 6: lyistructions for Cla 

Throughout the sixth condition, Greg receiyed instructions on the Cla 
problems. His accuracy immediately improved on these problems; his 
.four Cla scores were all 100%, On Cli? no more than two problems were 
incorrect per day. His scores for C2a and C2Z? were all high. Once 
more, all C3a scores were zero. 



Pha:Be ? : Removal of Instructions from Cla 

When instructions were removed from the Cla problems, he maintained 
high percentage scores. All but one of hfs Cla scores were 100% 
throughout this phase, AM 012? scores were 100%, On C22? he had a 
mean of 98.2%; for C22? a mean of 99-2%, Throughout this phase all 
scores on the C3a problems were zero. 

it 

If* t 
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Phase 8: Cuisinare Rods fox* C3a 

Greg was ncrw given a set of cuisinare rods to use as he worked the 
C3a problems. On the first day of this phase his C3a score was 100%; 
thereafter, his accuracy was variable and generally declined. His 
scores ranged from 36% to 100% with a mean of 62.5%* On the C3b prob- 
lems his scores ranged from 0% to 2k% (x = 9.3%). Slight within class 
generalization occurred. His two scores on Cla and one score on C]b 
were 100% in this phase. Meanwhile, on Cla and CZb his scores were 
drastically reduced from the previous phase. For' the first two days_ 
of Phase 8 his scores were zero ^on both sheets. ^ For the next four 
days he got only three problems 'correct on each sheet. 

Per forma ncevSh Cla worsened in this phase because Greg had devised a 
new adaptation of his old rule. Now he reduced the tens column by 1, 
then subtracted the top number in the units column from the bottom num 
ber (e.^, 52 - 2^ = 12). The focus throughout the next condition, 
therefore, was again on C 2a. 



Phase 9: Removal of Cuisinare Rods from C3a: Abacus Provided for C2a 

The rods were withdrawn from C3a in this phase and the abacus was once 
again provided for Cla problems. His percent scores on CZa steadily ^ 
increased in this phase; on the final six sessions his scores were all 
100^. Although his performance on the C2b problems was poor on three 
days in this phase, his scores were 100%. on 7 of 10 days. Once again 
within class general ization was demonstrated. Measurements were not 
taken on Cla or Clb during^-tfris-phate. On C3a and C3b his scores re- 
turned agair=to zero. 



Phase 10: Removal of Abacus from C2a 

During this condition the abacus was once again removed from C2a. 
This condition ran only two days^ since the pupil *s accuracy v/as very 
poor (x of 16%). Only four C2a and Clb problems were answered cor- 
rectly on both days. No measurement was obtained for the Cla, Cl£>, 
— or C3a, Cyb probliems in this condition. 



Phase 11: Instructions for C2a 

In the finaj phase, instructions were provided prior to Greg's working 
the C2a problems. During that brief phase, his scores on C2a and Clb 
were all 100%. "Again, within class generalization occurred. Only one 
C3a measurement was' obtained; that score was zero. 
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DISCUSSION 

In several instances within class ge ;ralization was noted* In regard 
to Cla and C]b when, in the second condition, attention was directed 
toward the Cla problems, not only did performance on that sheet improve, 
but his accuracy on Ob problems was also aided* 

Within class generalization was also noted when the foetus was on C2a. 
In Phase ^, when the aid was given while working the Cla problems, not 
only was the accuracy on those items positively influenced, but his per- 
formance on C2l? similarly improved* Within class generalization between 
Cla and Clb was again noted in Phase 9 when the abacus- was , for the sec- 
ond time, offered. the lad while he worked on the Clc problems. In 
Phase 11 such generalization was noted for a third time. 

A modest amount of within class generalization occurred in Phase 8. 
When attention was focused on C3a, some slight improvement was noted on 
the C3b items. 

Meanwhile, little, if any, across class general izat ion was observed. 
As the pupiTs performance on Cla and C1Z> improved in Phase 2, his per- 
formance on C2a and Clb v/as only slightly influenced. No change-was 
noted on C3a, the third class of problems. Similarly, in Phases 9, 
and 11 when performance on C2a and Clb was influenced, accuracy on the 
C3 class was unaltered. 

Throughout the experiment, three teaching aids were used. In Phase 2 
paper clips were used on the Cla problems; in Phases ^ and 9 an abacus 
was given the pupil as he worjced on the C2a problems. Cuisinare rods 
were given the }ad in Phase 8 as he worked oh the C problems. In ev- 
ery case effects, were noted. 

It should also be pointed oulr-that in two instances when the aid was 
removed, in a phase following the involvement of the instructional de- 
vice, his performance continued to be excellent. In Phase 3 when the 
paper clips were removed from Cla, in Phase 5 when the abacus v;as with- 
drawn from C2a, his performance held up. 

Performance, however, did not hold up when the abacus was removed from 
the C2a problems in Phase 10. Also, performance did not hold for the 
C3a problems when the rods were pulled off in Phase 9. 

In addition to the three teaching aids that were used, instructions 
were scheduled for two sets of problems. In Phase 6 instruction was 
provided, for the Cla prpb^lems; instructions were also used in Phase 11 
for the C2a , problems, 'n both situations the effects were positive. 
Only in the first instance was the' instruction removedin a subsequent 
phase. In Phase 7, when instruction was^no longer-bs^d^or the Cla 
problems, his accuracy maintained at the level achieved in the previous 
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phase. Since a quarter ended during Phase 11, when instruction was ar- 
ranged for the C 2a .problems, there was no opportunity to withdraw the 
Instructions, hence evaluate their effects on those problems. 



GENERAL^DISGUSSION 

A primary objective of. this research was to point out that two remedi- 
ation strategies are available for altering behavior; more specifically, 
the behavior of subtraction — rei nforcement. conti ngencies and teaching 
aids. Teachers should develop expertnes§ in scheduling both; for if 
they rely on one set of events more than the other, they are probably 
±^ tWS^ffective than they could be. 

The professional teacher is the one who can discriminate student per- 
formance to the extent that contingent or non-contingent events are 
most appropriately scheduled. This research suggests some pupil behav- 
iors to attend to in making the decision whether to use one type of 
procedure or the other, whether to establish a non^contingent or-con- 
tingent event. 

First of all, a careful error analysis is required before an effective 
remediation program can be established. A mere counting of the respon- 
ses, correct and incorrect, w?ll not gener.^lly inform the manager which 
instructional technique he should enlist. In the first-experiment the 
girl's errors follov/ed no apparent order, except that occasionally her 
'^answers'* were a series of numerals in consecutive order (e.g., 22, 23, 
24). It was also noted that on occasion she erred on none of the prob- 
lems. The first observation, that sometimes she simply wrote numerals 
in order, indicated that she was not making mistakes because of some 
erroneous rule. The second observation, that at times she could be ac- 
curate, signified that she could be precise when it appeared profitable 
to so behave. On the basis of these observations, it was hypothesized 
she would be amenable t:o contingency^ therapy. As for the selection of _ 
a reinforcer and a contingency, it was decided to use recess time, since 
earlier in the year she had been required to earn recess by her perform- 
ance in reading and this had proved effective. In PROJECT I minutes 
v/ere taken av/ay contingent on errors, whereas in the reading study they 
were given contingent on correct answer*. 

In PROJECT II an error analysis in Phase 1 -revealed that— the^dy sub- 
tracted the top numeral in the units column from the bottom numeral-- 
a type of mistake commonly made by children. For example, his answer 
to 13 " 5 was 2, and invariably his answer was 6 to the problem 12 - 8. 

«-r-Unlike. the girl in PROJECT I, this pupil's mistakes were • predi ctab le. 
/ He had his own rule, which although consistently applied, was a faulty 
code. Other studies had been c-nducted with this lad where non-contin- 
gent events such as simple instructions were effective in altering his 
performance. In a reading study, for example-^ when he was told simply 
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to "read a little faster," he generally did. fhis^avt then seemed to 
be a good candidate for some non-contingent rehabJJ i.tation. 

In conclusion, teachers must keenly a^d consj^stently observe and an- 
alyze the behavioral patterns of children in order to prescribe the 
most effective instructional technique. Teachers must be cognizant 
of the proficiency and quality of the pupil's performance; his error 
patterns that could be the result of erroneous rules; and, of course, 
his motivational system (which events or circumstances are reinforcing 
to him). 

Often, if the diagnosis focuses on exact components of a pupil's behav- 
ior, the designing of an instructional technique is, if not obvious, 
rather simple. Many times, if the diagnosis has consisted of a system- 
atic appraisal of the important elements of pupil behavior, the pupil 
will "tell" the manager which instructional plan to follow. Some as- 
pect of his performance will clearly inform the teacher as to which 
tactic to schedule. 

The teaching procedures used in these two projects were quite simple, 
in PROJECT I a rudimentary 1:1 withdraw contingency was arranged; in 
PROJECT II some uncomplex instructional aids were programmed. Such 
techniques can be easily used by any teacher. The teacher desiring to 
use the instructional events discussed here would merely need to be sys- 
tematic in the involvement of the techniques, he would not need to read 
a complex instructional manual or attend an expensive workshop. 

We, therefore, suggest that efforts be directed toward the sinplifSca- 
tion of all instructional components — designing rudimentary methods 
for diagnosis, devising uncomplicated procedures for instruction, de- 
veloping basic routines for evaluation — instead of proposing highly 
complex and_erudlte educational systems. *lf such a frugal approach to- 
ward education were adopted, education would be more ecumenical; more 
people woutd^be able to teach; hence, more individuals would learn.^^Y^" 
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Superimposing contracts 
upon a token economy 

^ Joseph n Jenkins 

sheila gorrafa 

The effects of several Incentive systems on the 
reading and arithmetic performances of twelve 
primary EMR children were investigated. "NormaP* 
(non systematic) classroom management was com- 
pared with a -token economy plus superimposed con- 
tracts over ah eight week period* Both reversal 
and multiple baseline designs were employed. 
Reading and arithmetic performances were highest 
when the token economy was combined with a su- 
perimposed contract* Performance was lowest when 
neither the token economy nor- the combination of 
tokens and contracts were in effect* 



Two approaches to contingency management in the classroom are contin- 
gency contracting (Homme, 1969) and the more general token systems 
(Neisworth, Deno and Jenkins , -l#69) . In contingency contracting an 
agreement is struck between two parties, the teacher and her students. 
The agreement in its general form states that when the student accom- 
plishes a particular performance then some event, activity or object 
will be provided him by the teacher Under a token system, on the 
other hand, the teacher sets a token value on a number of different 
student performances. At the same time she identifies a variety of 
events, activities or objects for which the tokens may be exchanged, 
these two approaches, of course, are closely related. In fact, con- 
tingency contracting as described here is a special case of what oc- 
curs in^a token economy. The major difference is, that under contin- 
gency^^contracting there is a one-to-one relation between the perfor- 
mance and its consequence which renders unnecessary a medium of ex^ 
change. In most instances either one or the other approach is employ- 
ed separately. The study reported here investigates the effects of a 
token system and of a superimposed contingency contract on the academ- 
ic performance of twelve EMR children* Data on the children's academ- 
ic performance were collected under conditions of no»tokens, tokens, 
and tokens plus a superimposed contingency contract* 
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METHOD 

Subjects and- Setting 

The study was conducted at the Experimental Educational Environment 
(EEE) , a Newark School District ESEA Title III Program which is lo- 
cated at the University of Delaware. Twelve EMR children vvhos_e ages 
range from 6 to 11 participated in the project. 

The EEE is administered on a contingency management system with an 
ancillary toRift economy (poker chips) where children are rewarded for >] 
academic apdJ&ocially appropriate performances. Work shjeets and pt^^F^-^^^^ 
grammed texts are provided regularly. Individual contracts Ire-es^ 
tablished on a piecework basis in which there Is a specific relation 
between the amount of work performed and the number of tokens earned. 
The classroom operates on a free spending system (Neisworth, Deno and 
Jenkins, I969) in which the student chooses how and when he wl 1 1 spend 
his earnings. The child has the option of stopping work on an academ- 
ic task after he has acquired sufficient tokens to enter the reinforc- 
ing events (RE) area, or, of remaining at work In the task area where 
he may continue to earn tokens for later spending. The RE area is I0- 
cateH~ln the rear of thfe classroom. There, the children may engage 
in a huni)er of high preference behaviors, such as bowling, painting, 
writing on the chalkboard, etc. A store wi.thin the RE area contains 
other commodities such as coloring books, bubble bath, candy, (the 
larger items are purchased on a lay-away plan) , etc., which may be pur- 
chased at the end of the school day. 

Recording and Reliability t — ~ — 

The dependent measures in the study were pages completed by^ the chil- 
dren in their programmed readers (Sullivan Associates , ^1969) and the 
number of correct problems completed oh their dai.ly arithmetic work 
sheets. 

Each student kept a record sheet at his desk. Th^ls sheet had spaces 
for recording the page numbers from the programmed reader successful ly_ 
completed and the number of arithmetic problems which had been worked 
correctly. The teacher and her aide acted as recorders, checking each 
child at his seat a minimum of two times In the morning and again in 
the afternoon immediately before the children left. A student was 
checked on the average of five times per day. At the end of each check 
the recorder paid the" student fpr the number of pages and problems cor- 
rectly completed. During these checks the student would-present his 
reading answer sheets, where he had recorded his answers to each pro- 
gram frame, and also read upon request sample frames from each program 
page that he had completed since his last check. The recorder correct- 
ed the reading answer sheets. If there were more than three errors the 
student was asked to redo that page. If there were three or fewer er- 
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rors, the recorder chose two frames from each page for tfee student to 
read orally. When a student misread a word the teacher pointed to tjie 
word and asked the student to ^'sound It out;*' .If the student did not 
read the word correctly after this procedure then it was counted as an 
error. If more than two of these uncorrected errors occurred, the 
page was not counted in the student's total* Whenever f requent*"errors 
occurred the teacher or aide would spend a short time helping the 
child with the words which posed a difficulty for him. 

When the child finished reading the sample frames the recorder marked 
on the student's jecord sheet those page numbers that the student had 
completed successfully and paid him the number of tokens he had earj^d. 

Arithmetic problems were also recorded during these checks. The re-' 
corder corrected the completed worksheets, on the spot, designating 
problems correct and wrong. The number of correct problems was marked 
on the record sheet and the student was paid for those. Students were 
always encouraged to correct their mistakes. On later recording checks 
the student was given credit for and paid for corrected problems. 

An elevated observation deck and one-way mirror overlooked the class- 
room. Spot rel iabi 1 i ty checks on the reading and a ri thmet ic measures 
w ere made through out the year both from this observation deck and from 
within the classroom. F?r reading a rel iabi 1 i ty. check was made by a 
judge other than the teacher or aide who listened as the child read 
sample frames to the recorder. An independent judgment was made for 
each page as^ to whether the child had performed, sat isfactori ly (three 
or fewer errors on the answer sheet and two or fewer errors on the 
frame reading). Agreement between observer .and recorder was consistent 
ly high, concurrence on over 90% of the pages checked. 

For arithmetic recording, reliability was checked by periodically re-_ 
correcting arithmetic work sheets. Correction errors rarely exceeded 



'Treatment . Sequence 

A multiple baseline design was employed wherein treatments were applied 
to reading and mathematics independently. ^ 

The study lasted eight weeks. Week 1 was a normal token week. The to- 
•ken economy had been operative for seven months. During this and other 
token weeks wMch follow .the children earned and spent tokens for per- 
formances and events which were described "above. Week 2 was the first 
superimposed contract week. In this and subsequent superimposed con* 
tract weeks children continued to learn and spend tokens as they had in 
a regular token week. In addition, however, they negotiated an indiv- 
idual contract with the teacher which stated the amount of reading and 
arithmetic they must perform to earn an. extra privilege. The teacher 



used as a guideline In her negotiations the child's high performance 
days during the token weeks. In Week 2 the superimposed contract in- 
volved outdoor play. For each child a contract was set which stated 
as soon as both a specified number of pages In his programmed readers 
and a specified number of arithmetic problems had been correctly com- 
pleted he^could play outside until 11:00 A.M. 

The purpose of this arid the subsequent superimposed contract week was 
to determine if reading performance could be Increased, but not at the 
cost of decreasing arithmetic performance. Therefpre, the contracts 
called for approximately the same number-M;xf_ arithmetic problems* com- 
pleted as In the previous week. Only the reading was augmented. 

4 

Week 3 was again a superimposed contract week. This time the children 
contracted for a sight-seeing train ride. Each child negotiated a 
combination reading and arithmetic contract on Monday for the trip 
which was planned for Thursday. Again only reading was augmented. 

In Week ^ the class returned to tokens with no additional contracts, - 
the same conditions which prevailed during Week 1. 

Week 5 was a no token week. On Monday the teacher Informed the class 
that the store was closed. She paid no tokens for performance that 
week, nor were play time and other high preference activities contin- 
gent on any student performance. ? 

During Week 6 the token economy vra^ "resumed. The conditions of this 

week were the same as those during the Weeks 1 and 4. 

♦ 

Weeks 7 and 8 were both superimposed contract weeks. Monday of the 
seventh week was not a full school day. Tuesday of that week the teach- 
er announced that a picnic In a nearby park was scheduled on Friday af- 
ternoon vor those children who wished to contract for It. Again, indiv- 
idual contracts were written stating the number of programmed reader 
pages an. arithmetic problems heeded for admission to the picnic. On 
this and the subsequent week both reading and arithmetic performances 
required for fulfillment of the contract were Increased relative to the 
children's per forma nee ^in Week 6. - - 

On Monday of the eighth week the teacher announceo that on the subse- 
quent Friday' the class could earn a full day bus trip to the beach. 
Again, individual contracts were negotiated ."Ari thmet ic contract de- 
mands were augmented' wh i le reading requirements were approximately 
equivalent to those of the previous week* 



RESULTS 

The mean performances^ of the students over eight weeks In reading and 
arithmetic are shown In Figures 1 and 2. • 
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Fig* I* Mean jages rjead/day by individuals during 
the Fight' Weeks. . ^ 



the maan performance of ^the c I as*^ shifts approprnately wi th ^ach- change 
in contingencies. The highest performances are obtained when superim- 
posed contracts are fneffect. The normal token economy produces the 
next highest performance* FJnally,. the lowest performances are ob- 
served when neither" the token economy nor the contract Is operattve. 

Comparisons of li ndividual chlHren's performance In successive weeks 
was reveal ing. ^ ' ^ . / 



Reading Perfomarice * . 

The reading performance of ten of the twelvC^chi Idren Increased from^ 
WeeK 1 to^Week 2, tokens to .a superimposed cpntVact, p<.02, sign test, 
In the trahsitipn from a superimposed contract to tokens. Week 3 to - 




W - ~ • • 

12 3 4 5 6.7-8 

SUCCESSIVE WEEKS- 

Fig. 2, Mean arithmetic problems completed/day by ' 
individuals during the Eight Weeks, ' , ^ . 

Week- 4, eleven, of the twelve children decreased their output, p<;003, 
sign test. The effect of terminating the token economy is observed in 
the decreased output of eleven of the twel ve-chi Idrem f rom Weeks ^ to 5, 
p<:,pb3^'sign"-test. Resumption Q.LJJm token economy was not particular- 
ly impressive in that only eight of the b^elve' children made increases^ 
A gradual increase in performance occurred over the fJ TSt .. th ree days of. 
the renewed token economy (Monday, 5-17; Tuesday, 7*0^; and- Wednesday , ^ 

Superimposing a contract again increased performance above that observed 
under the -token ryit'em by itself, Week 6 to Week 7, with eleven of the 
twelve children showing an increase,, p<.003. 



Arithmetic^ Performance 



Since t|ne contracts for arithmetic demands wer e no t augmented signif- 
icantly during- the first two superimpQsed-con^tracts , the fi rst inter- 
esting , data on arithmetic performance involve the. effects of terminr- 
ating the token economy. With this change from Weeks k to 5, ten of 
the twelve children decreased their arithmetic production, p-<*02,* 
sign test. Subsequently in^Week 6 when the token economv was rein- 
stated, ten of the twelve children increased in arithmetic performance. 

When a superimpos * contract wl-th-an-^ugmented arithmetic demand was 
instated. Week 7i all twelve of the children ijcreased their arithmet- 
ic output, p< .001, sign test, finally, in the eighth week, the last 
superimposed contract week, eleven of the twelve children completed 
morej^thmetic problems than in the previous week (p<.003), consis- 
tent with the demands of their contracts. 

^.he ;data suggest- that token systems and contingency contracts can be 
-combined to influence academic performance. Further investigation of . 
this topic wo.uld be welcome, particularly in regards to criteria used 
to determine the conditions of cont i ngency contracts . Determining the 
amount required of students for contract fulfiriment is at times dif- 
ficulty for- the practitioner. In the present study the teacher relied 
upon both her own intuition and upon the children's past performance. ^ 

There is another problem with using contracts excl usively especially 
when *:he contract has a time constraint. If a .child fai,ls to complete 
his contracted reading and arithmetic he is'" lef t behind while the other 
chl Idren visi t the beach or see a play. There is some security in gen- 
eral token rystems In as much as- time is generally not a factor and^ 
there is a variety of events differing in cost for wh ich' tokens^ may^e 
exchanged. Seldom is a child left without some reinforcing alternative. 
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College student study beh^ior 

IN A 

PERSONALIZED INSTRUCTION COURSE 

AND IN A LECTURE COURSE ^ 

david g. born/ michael davis 
y paul yidtelan; donald Jackson 

The orocedures comprising 'the pensboal I zed' system of rnstruC'on (PSI) 
described by Keller (I966, I968) contrast sharply with trad?,.. onal 
methods of college instruction. In comparison with lecture tnstruc- " 
1 1 ona-r formats , PSI has been shown to produce superior performance on 
traditional examinations (Born^ Gledhill and Davis, 1972; McHichael and 
Corey, 196JLL Sfieppard and MacDermot, 1970)^ mere favorable ratings on 
^questionnaires (e.g». Born and Rerberf, 197Q; Ga^ lup,' I969) , and fn 
some cases a higher percentage of withdrawals from courses (Born, 1971a, 
1971b). The present experiment attempted to determine hew the amount 
and distribution of student study over an academic term would differ 
under PSI and a lecture dominated instructional, system. 

* method:, 

« 

The amount of time spent studying, by students enrolled in a PSI section 
and a lecture section of beginning nsychology v/as monitored by making 
course materials aval fable only* in a special Study Center where a mon- 
itor checked out study units to students and noted (a) the tjj^ of en- 
try,, (b) the unit requested, and (c) the t»:ne of exit. A stu^y m\Lt 
included botb the printed material comprising the reading assignment 
and "i le-^gthy set of study i*tems. Students in both sections had access 
to the same material presented in the same format.' 

PSI Procedures^ 

Course material was packaged 'In a 'series of eighteen units and all stu- 
dents were required to pass a short written test over each unit of ma- 
teriai. Each unit test was evaluated by a proctor, and students were 
allowed to progress to the' next unit only if each item was judge.d cor- 
rect. If the -student mfxvsed one or more J terns he was asked to re-study 
and take a different examination over the same unit pf material. Be- 
caare there wer e appro ximately fifty percent more days scheduled for ex 
aminations tharTthere were examinations to be taken,- students had some 
opportunity to complete the course at their own rate. Twice a week 
(Tuesday ^"Thursday) students coTiTd attend a series ^f optional lectures 
movies, and demonstrations v^lch supplemented the idir^ material. 



Lecture Course 



Students enrolled in the lecture course could attend lectures closely 
related *to the course reading material on Monday, Wednesday, and Fri- 
day, and .could joi.n students in the PSI section on Tuesday and Thurs- 
day for the special series of lectures, demonstrations, and films* 
Attendance at all class meetings -was optional and students were told 
tRey would only be tested over the written material' comprising the 
"S'tudy units. 



Major Examinations * , 

Students in both the PSI and lecture classes took the same hourly mid- 
term and final examination. Each of these exams consisted of multiple 
choice and, short-answer essay items and was given at ^two different 
times, about one week apart, to permit students jto^select their own 
examination date. Students in the PSI class had to complete the first 
nine units of course material prior to taking ^the midterm examination 
over that material, and the last nine unit exams prior to taking the 
final. None of the exam items had been used earlier in the course as 
study questions or questions on unit examinations. 



, ^ RESULTS AND DISCUSSION 

An analysis of exam scores revealed that the superiority of the mean 
test performance of the PSI section. was statfsti cal ly reliable (p < ,05) 

similar results have been reported earlier investigators (e.g.,^* 

McMichael and Corey, 1969) .* rPtif^tHeiV there were large and statistic^ 
al ly/ rel iable differences in the mean total study time invested in the 
course by students 4it-the-twe-sect ions (see Figure 1). Relative to the 
mean of 30.34 hours of s^tudy "in the lecture section, the mean of 45.62 
hours of study in the PSI section represented a fifty percent increase 
in total study. 

An analysis of mean cumulative study time prior to taking the midterm 
(see Figure 2) ,^^and i-rom the midterm to the fjnafl examination, revealed 
a fairly constant average rate of study by early -and late exam takers^ 
in both sections^ but the s^lope of the mean cumulative graphs was"' 
quite different. However, there was substantial variation in both 
the pattern and total amount of study by. individual students prior to 
^ach exam (see Figure 3). For some ^>ludents (e.g., P?., P4, L5) study 
commenced early and occurred regularly up to an examination; for others 
(e.g., Ll^ 't2) study started later in the term and/or it was^er ^ t U c - 

Although a greater total amount of study occurred in the PSI^section, 
If one adds the average number of hounly lectures attended (X « 19) 
;to average study time for the lecture *c1ass, the total time of pre- 
paration for students in the two class^ is nearly identical. Consid- 
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ering that PS I produces superior (learning) performance on examina- 
tions, relative to our lecture format, for comparable hours of pre- 
paration PS I would seem to be the method of choice for students • 
.30 
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Fig. I. Histograms showing- total number: of hours of 
study by students in the PSI and lecture section of a 
class in beginning psychology. Because there were dif- 
ferent numbers of students in the two sections the ab- 
solute frequencies falling in each 10-hour interval 
have been converted into proportions for each section. 
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^ ^. Fig. 2^ -Mean cumulative study time for 
. students taking the early and late mid- 
, terms in the PS I and lecture sections. 
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Fig. 3. Individual study profiles up to the mid- 
term exam for several students in the PSI\and_lec- 
ture class* The students selected were the two 
students from each- section who spent the^ least ^tlme 
In preparation (Li and 12, PI and 'P2) and the two 
students who 'spent the most time (L3 and P3 and 
P4). Becausje L5 was^^n^ery atypical^ student in the 
lecture section, the record of iL4 has also been in- 
cluded. „ 
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The 

measurement & analysis 

^ OF 
COLLEGE STUDENT STUDY BEHAVIOR 

James m. Johnston 
mhhael a. roberts 
george w* o'n&ll 

The program of behavior analysis which Drs, Pennypacker and Johnston - 
began -in I968 has as its goals the systematic empirjcaj investigation 
of college level teaching' techniques ^and student academic performance, ' 
and the resulting development of improved techniques which will pro- 
duce improved performance. To date the study behavior of students'^ 
has been among the variables least investigated^ by ourselves and by 
others in this area, and this lack of, research emphas-is Sjeems to be 
unusually disproportionate to its potential importance, A student's 
study behaviors are pcobably^ the class of responses most influenced 
by teaching procedures and the most ijnferuehti al ^[n affecting his aca- 
demic performance. The reasons for this disproportionate^ emphasis 
most probably stem /from the- fact that in most institutions of higher 
education, studenrt study behavior both withjjj^and across students oc- 
curs at the choice of the individual student in^a wide variety of- phys- 
ical setti.ngs at all hours of the day and night. Jhus,^ unless a teach- 
er -cah control the time and place of his students* studying, there ex- 
ist cons ide table *probl ems ofj observation^and measurement. 

This difficulty dictated some form of sel f-report i ng by the Individual 
student in such a way that the^ measurements .would be as direct, contin* * 
uous, and accurate as possible. The first step wes to construct a fair- 
ly exhaustive list of the possible variety of different study responses. 
This list was then organized into a. conci se' format- wh ich was easy to un- 
derstand and quick to use. — * . 

The first Study Report Form (SRF) which resulted is shown in Figure T. 
The top of the sheet has places^ for identifying information and* is fol- 
lowed by some brief instructions.- After circling the total time studied 
for the period under meas ureme nt (to the nearest half hour), the student 
rated each separate study responses he emitted on a 0^ to 5 continuum. 
The ratings somewhat crudely denoted the amount or proportion of the to- 
tal, time circled which was devoted tq-each of the separate study re— ^ 
sponses, rated. The ratings ranged Trom^ none of the time (0) te"a4-^^f 
the t ime ,(5) . 

Both this" form and a subsequent version which'was experimented wl th suf- 
fered from atJeast one major disadvantage. The students completed, the 
form only when they came In to perform on the course material (an aver- 
age 9lL twice a week), and they therefore had to summari^ze and report 
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The program of behavior analysis which Drs. Pennypacker and' Johnston - 
began .in I968 has as its goals the systematic empirjcaj investigation 
of college level teaching techniques -and student academic performance, " 
and the resulting development of improved techniques which will pro- 
duce improved performance. To date the study behavior of students'" 
has beeji among the variables least investigated by ourselves and by 
others in this area, and this lack of^research emphas-is sjeems to be 
unusually disproportionate to its potential importance, A student's 
study behaviors are pcobably^ the class oiF responses most influenced 
by teaching procedures and the most inSluential^in affecting his aca- 
demic performance- , The reasons for this disproportionate, emphasis 
most probably stem /from the- fact that "in most institutions of higher 
education, studerrt study behavior both wi tfiiji^^and across students oc- 
curs at the choice of the in^yidual student in-a wide variety of phys- 
ical settings at a"l 1 hours of the day and night. Jhus,^ unless a teach- 
er -can control the time and -place of his students/ studying, -there ex- 
ist considerable -problems of? observation* and measurement. 

This difficulty dictated sojiie form^of oelf-reporti ng by the Tndivi dual 
student in such a way that the measurements .would be as direct, contin- ' 
uous, and accurate as possible* The first step was to construct a fair- 
ly exhaustive list of the possible variety of different study responses. 
This list was then organized into a, concise format- which was easy to un- 
derstand and quick to use- — ' . 

The first Study Report Form (SRF) which resulted is shown in Figure ll 
The top of the sheet has places^ for identifying information and' is fol- 
lowed by some brief instructions-- After circling the total time studied 
for the period under measuferaent (to the nearest half hour), the student 
rated each separate study responses he emitted on a 0= to 5 continuum. 
The ratings somewhat crudely denoted the amount or proportion of the to- 
tal time circled which was devoted tq^eacK of the separate study re- 
sponses rated- The ratings ranged^Trom none of the time (0) te-'a4-l— ef 
the time. (5)- 

Both this" form and a subsequent version which was experimented wl th suf- 
fered from a.tJeast one major disadvantage* The students completed, the 
form only when they came In, to perform on the course material (an aver- 
age of^twlce a week), and they therefore had to summari^ze and report 



from memory all -of the various study episodes which occurred since the 
last time they were in to perform. This was the reason for requiring 
only the relatively crude ratings rather than a reporting of actual 
times for the separate study behaviors. It seemed that regardless of 
any increased precision whi ch might, be designed into the form itself, 
the delayed^nature of its use guaranteed a certain minimum of inaccu- 
racy and coarseness in the data. ^ 

•This conclus^ion .resulted in the most recent revis ion. shown in Figure 2 ' 
which ijicor-porated-a number o^ significant changes. The separate piedes 



STUDY REPORT FORM-TS ^* STUDENT 



UNIT TRY RC RtC CC CIC 



dates. 



-STUDY EPISODES^: 
PLACE OF STUDY. 
LEVEL OF DISTURBANCE (low 12345 highX;^; 

-TOTAL TIME OF EPISODE (mi nutes) . . . J .< 

READ I FIRST T-JME: text ; 

* other C . ) 

written aids < 

* * lecture 

MAKING WRITTEN AIDS: 

outlining^. • • • % TTT. 

underlining y brackets v , 

surnmarizing . ^ 

temsy names definitions. , . 

examples^ applications. . 

transcribe lecture 7... 

fitl^in questions 

multiple-choice questions 

essay questions % , 

USING AUDIO-VISUAL AIDS: 

filmsy slides y pictures 

. tapes . 



other ( 
^ELF-jUIZZlNG: 



STUDYING WITH^ 



text joral-o 

. ii)ritten aids ^ s i Lent-s 
gudio-visual . f^wr i tten-w, 

'other ( ) , 

OTHERS: number r. . 

discussion* .... 




qu^zz^ng^^ 

• , making written aids. 
ACTUAL OR ESTIMATED: A or ^......rrr 



J 



Pig. 2. Second revision of the 
Study Report Form. - ' 



# 380 



of Information requested were edited and reorganized, making it possible 
to reduce the size of the form to 5" x 8" so that It uld be kept In the 
student's textbook. This was'done because now the sc. .;nt was Instruct- 
ed to fill out the SRF during or Immediately after each Individual epi- 
sode of studying which occurred 'between scheduled performances. However, 
Instead of approximating the tinie for each studying response by 0-5 rat- 
ings, he now recorded the actual time (to the nearest minute) he spent 
engaged in each kind of study response. This change permitted the pos- 
sibility of a more detailed examination of the pattern of studying across 
separate episodes as well as considerably more direct and accurate obser- 
vations. The reverse side of the SRF contal ned'^efbbrevi ated Instructions 
and explanations of the different studying responses (Figure 3). ^ 

^ ' JMSTWCTIONS FOR STIWV REPORT FORM 



^mPOHTANT: Copplete during or ImmedTately after each study 
- episode* 

STliVV EPJSOVE ' a relatively uninterrupted period of study separ- 
ated from other episodes by other activities. 

PLACE OF STliVV - write in where the episrde occurred. 

LEI/EL OF PISTURBAWCE - rate 123^5 any visual, auditory, or other 

d i stract ions. 

TOTAL TIME OF EPTSOVE - mark actual time of entire episode to 

the nearest minute. 

REAPIMG FIRST TIME - reading for the first time ever. 

REREAPIWG - any reading except the first reading. 

^ MAKING WRITTEN AIPS: 

^ Oattining -"'constructing formal or informal outlines of 
any part of the material. 

• UiviQAtinlng , Bn^ack^U - marking any parts of the text, 

written aids, lecture, other. 

• SutmoAlzlng - writing summaries of units, chapters, para- 

graphs, etc. 

• TQAm6 , h!am2^ , V^{^inAJU.on6 - writing terms, definitions, 

concepts, important points, etc. 

• ExamplQ^ , AppticatioiU - writing examples, applications, 

^ uses, etc. 

• TKan6c^be LzcXuAe, -N:opyIng yours or other lecture notes 

or transcribing taped lectures. 

• QjjiUtion^ - constructing any of the listed types of questl-OQS. 



USm AUPIO-l/ISUAL MVS:' " 

• film , SLidiU , Pictu/iQ^ ' time spent viewing* 

• TapoA - time spent listening. 

SELV -QUIZZING - mark time spent in oral, silent, or written self- 
quizzing on any material. 

STUVVWG WITH OTHERS: 

• himbzx - mark the number studied with. 

• VAJ>Cii66ion - talking about material with others. 

• QlUzzinq - quizzing each -other oral ly or written. 

• hkking {SnJJXdn McU - based on group di scussion or others' 

written aids. 

ACTUAL o/i ESTIMATEP - mark A or E if most times are actually cor- 
rect or estimated later. 



Fig. 3. Instructions for second revision 
of the Study Report Form. 



Following the first semester's use of this version of the SRF, the stu- 
dents In an abnormal psychology course were asked to complete an anony- 
mous 'questionnaire* regarding their use of the forms. They rated on a 

to 5^ scale the extent of their disagreement or agreernent with a series 
of statements. A J_ signified strong disagreement and 5 signified strong 
agreement. Some of their reactions are shown In Figures k through 9. 
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Fig. 4. Student responses on a / to 5 agreement scale 
to the statement. *M usually kept the SRF's in my text." 
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Fig. 5. Student responses on a / to 5 agreement scale 
to the siatement, **| usually completed the SRF during 
or soon after each episode of study.** 
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Fig. 6. Student responses on a / to 5 agreement 
scale to the statement, "I usually estimated my 
times Vather than using a watch or a clock.'* 
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Fig, 7, Student responses on a J 5 agreement 
scale to the statement, "After I got used to \fl 
the SRF was easy to fill out," 
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Fig. 8* Student responses on a / to 5 agreement 
scale to the statement, "I really didn't mind if 
my Student/Teacher saw my SRF*" 
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Fig/ 9. Student responses on a I to 5 agreement 
.scale to the statement, "I usual ly tried to be 
accurate and honest on the SRF." 



The development of the SRF Is still in only the preliminary phase. Re- 
visions in Its format, content, and use are made at the end of every 
academic term based on the data produced, and alt data are now contin- 
uously computer processed. The demonstration of the validity of the 
SRF as a measuring tool Is of paramount Importance prior to further 
use, and the task is tactically difficult* However, such an empirical 
program is now in progress. 

The remainder of this paper is concerned with the potential uses of 
the SRF. The data included are presented only as an example of the 
kind of information which might be available from its use and is not 
intended to be Important In and of Itself. 



Research 

The SRF had considerable utility and Importance both as a research and 
as a teaching tool. There are literally hundreds of relationships 
which might be empirically examined In a single subject or group de- 
signs with study behaviors being either Independent or dependent vari^ 
ables. One area of research with promising potential is the investiga- 
tion of the effects on academic performance of varying the kinds and 
quantities of different study behaviors. An equally Important approach 
would entail observation of the effects of different i ns tiJC tional pro- 
cedures on study' behaviors . The eventual goal of these and other re- 
search programs should be to empirically define the most effective and 
efficient study techniques for different subject matters and different 
teaching methods. This 1s in addition to the strictly heuristic use of 
the SRF In research to assist in examining other aspects of teaching. 
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Beyond its value as a research tool, the SRF offers an important means 
of improving our efforts at evaluation: evlauaiion of teachers them- 
selves, evaluation of curricula, and evaluation of ^teaching methods. 

Teacher Evaluation 

The assessment of a teacher and his methods is one of the more complex 
tasks facing higher education. However, even more* di f f icul t and sensi- 
tive is the measurement of the effects *on students of the teacher him- 
self independent of the general techniques he or she uses--that is, the 
effects of a teacher's actions and personal interactions regardless of 
whether or not in general he is giving lectures and essay exams or i n- 
dividualized instruction and fill-in quizzes. 

.An example of the use of the SRF in this kind of evaluation may be seen 
by comparing the data from three student' teachers using the same meth- 
ods in the same course. This project was conducted in the Teaching 
Center at Georgia State University, Winter Quarter, I97I , on a junior- 
level course in abnormal psychology. The course was conducted in a man- 
ner similar to that described in Johnston and Pennypacker (1970, and 
Johnston and' O^Nei II (1972). 

Very briefly summarized, each student in the course was assigned to an- 
other undergraduate (here called a Student-Teacher) who had previous ly 
completed ' the course wi th-* exceptional performance. After the student 
had studied a unit of text material, he signed up on his Student-Teach- 
er's appointment sheet for a Performance Session at a particular time. 
Upon arriving he was given a confidential SRF (the origi*nal version) to 
complete. The student and his Student-Teacher then sat down in a booth, 
.and the student was handed a variable number of fill-in questions typed 
on 3" X 5** cards. These 35 to 55 or so items were randomly drawn from 
a P90I of 100 or more for each unit of subject matter in the course. 
After reading and answering aloud the stack of items or until a set per- 
iod of time (often 10 minutes) had elapsed, the student and his^ Student- 
Teacher then engaged in an important required period of discussion of 
errors, text material, class material, etc. The student's rates of 
correctly and incorrectly reading and answering the fill-in items were 
computed and plotted on each student's own graph of his course perfo'^m- 
ance. The student also wrote those rates on his SRF and deposited it 
in a locked box. If the student's performance unit met the course cri- 
teria he would begin working on the next unit. If not, he would come 
back to perform again (and again, if necessary) until he attained the 
criteria. Students who met or surpassed the criteria on every unit re- 
ceived an A_ in the course. 

Table I presents the mean performance data and some SRF data for three 
different Student-Teachers who were using the same procedure in this 
course. Three Student-Teachers were chosen whose students' mean rates 
of correct and incorrect responding are highly similar so as to empha- 
size the differences in study tactics among the three groups. Given 



• TABLE 1 

;./£'/!// PERFOR!-!ANCE AND SRF DATA FOR THREE- 
STUDENT-TEACHERS USING THE SAME TEACHING 
METHODS. 



Student-Teachers 





.... » 










RATE CORRECT 


3.6 , 


3.5 


3. 3 




RATE INCORRECT 


.s 


.9 


.9 




NO. PS/UNIT/STUDENT 


■ 2.3 


2.6 


3. 1 




HOURS OF STUDY/PS ■ 


4. 1 


3.1 


4.5 




READING FIRST TIME 


2.3 


■ 2.5 


■2.4 




REREADING 


2.5 


1.3 


2.1 


1/1 

c 
c 


UNDERLINING 


3.0 


l.S 


1.7 


*J 


OUTLINING 


1.3 


.3 


.5 


on 


SUMMARIZING 


2.0 


.3 


.4 


1 


TERMS, NAMES, DEFINITIONS 


2.9 


.6 


.6 


o 


SELF-QU1 ZZ 1 NG-S 1 LENT-TEXT 


2.5 


1.7 


1.1 




SELF-OUIZZUnIG-SI LENT- 
WRITTEN AJ-DS . 


1.S 


.7 


.5 



identical teaching methods and resulting performance, the data shov/ 
some unanticipated and interesting differences in study behaviors 
among the three sets of students. There is a wide range of the number 
^of Performance Sessions (PS) peaunit per student betvyeen Student- 
Teachers A and C, and an even w^pr range (almost an hour and a half) 
of study time per Performance Session* between Student-Teachers B and C. 
Th»i reported proportion of time spent reading the material for the 
first time was quite constant across the three groups, but the stu- 
dents of Student-Teacher B spent only half as much time rereading as 
a study tactic compared to the other students. There are sizable dif- 
ferences across the three sets of students on the time. spent in si- 
lently quizzing themselves on the text, and these ratings are Inversely 
related to the number of performance sessions per unit per student, 
suggesting^that this is an effective and efficient study Behavior. 
Finally, the average ratings of the students of Student-Teacher A were 
generally higher than those of the other two groups. 
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Differences similar to these have frequently been observed among the 
other Student-Teachers of this and other courses. Although some dif- 
ferences could be in the students^ academic backgrounds, an important 
question concerns' what in the behavior of the Student-Teacher could 
produce such differences in the patterns of study of their students? 
It would seem that we should examine more closely the ways in which 
Student-Teachers, Proctors, Managers, etc., can and do influence the 
study tactics and performance of students. f:or instance, does how 
errors and«text material are discussed make a difference? Does Stu- 
dent-Teacher enthusiasm make a difference? The SRF should be most use- 
ful in answering these and other questions. 

Curriculum Evaluation 

.In addition to teacher evaluation, the SRF has conquerable value as a 
tool to assist in curriculum evaluation. It has long been clear to 
teachers that the nature of the subject matter itself has measurable ef- 
fects on both the student's academic performance and his study behavior. 

An example of how the SRF can be used in this fashion may be seen in a 
comparison of a junior-level course in experimental psychology with the • 
previously described abnormal psychology course. The experimental psy- 
chology course was conducted at Georgia State University using the same 
teaching methods as described above for the abnormal psychology course. 

Table II shows the mean difference in performance and in some study be- 
haviors for the two courses. Compared to the abnormal course, data from 
the experimental course show markedly better performance, almost a whole 
Performance Session less per unit on the, average, and more than a half 
hour less study per Performance Session for each student. This resulted 
from the fact that students in the experimental course spent proportion- 
ately more time reading the material for the first time', rereading the 
material later, underlining and marking in the text^ and writing down 
terms, names, and definitions. 
« 

While it is possible that some differences might have resulted because 
the two courses could have attracted* students having consistently dif- 
ferent study skills-, similar differences have been regularly observed 
among courses of other subject matter and among different units in the 
same -course. The example is intended to show how the SRF might be used 
to answer questions such as the following: 

^ How do you empirically define the difficulty of material? 

:kDo two different texts for the same material produce different 
study patterns and performance? 

Should a teacher chxxnge some part of a course curricula? 
"kAre all units of equal difficulty? 

kDo you need to emphasize certain study behaviors to get better 
performance with different kinds of material? 
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TABLE II 

MEAN PEEFORMANCE AND SRF DATA FOR TW 
DIFFERENT COURSES USING THE SAME TEACH- 





ING METHODS.. 

• 








Course * 


Abnorina 1 


Experimenta 1 




^ : 


▼ 


▼ ■ 




RATE CORRECT 


3.2 






RATE INCORRECT 


1.0 


.« 




NO. PS/UNIT/STUDENT 


2.9 


■ 2. J. 




HOURS OF STUDY/PS • 


3.4 


2.S 




READING FIRST TIME 


2.4 


3.1 




REREADING 


2.4 


3.0 


01 






3.2 


c 


UNDERLINING 


2.1 


a: 


OUTLINING 


.i 


.9 


LA 

1 


SUMMARIZING 


.9 


1.0 


0 


TERMS, NAMES, DEFINITIONS 


1.5 






SELF-QUIZZING-SI LENT-TEXT • 


l>i ■ 


1.7 , 



Method Evaluation 

One of the most valuable uses of the SRF is as a means of evaluating^ 
' variations in teaching methods* An excellent example of -such usage is 
in the SRF data collected as part of the Johnston and O'Neill (1972), 
study. This project was conducted with another section of the pre- 
viously mentioned course in abnormal psychology using the same teach- 
ing procedures which have already been described. In this case, how- 
ever, the independent variable manipulated was the minimum performance 
criteria for a course grade of A. There were five experimental condi- 
tions, two of which will be discussed here. 

In Experiment I the students had no criteria to work toward; they were 
simply told that they would be graded on the curve along with others in 
their group. They were frequently urged to do their best. In Experi- 
ment II the criteria followed a High^ Medium^ Low, High sequence through- 
out the quarter, and the students were told that if they met the criteria 
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on each unit (whatever it was) that they would get a course grade of 
A. 

Table III shows mean performance and SRF data for both sections.^ In 
Experiment II it can clearly be seen that the quality of performance 
closely follows changes in minimum criteria. Of primary interest here 
however, are the changes that occur In the students' study tactics as 
the criteria requirements vary. Almost all of the study behaviors 
show consistent changes related to the criteria shifts. Thus, the 
changes in performance result from not only changes in the quantity 
but the quality of study as well. 



TABLE I 1 1 

MEAN PERFORMNCE AND SRF DATA FOR EXPEH- 
IMENT I AND EXPERIMENT II 

EXPERIMENT II EXPERIMENT I 



CRITERIA 




f 






NO CRITERIA 


RATE CORRECT 


3.S 


3.2 


2.7 


3.2 


2.5 


RATE INCORRECT 


1.0 


1.2 


1.2 


1.0 


1.5 


HOURS OF STUDY/ 
PERF. SESSION 


3.0 


2.4 


2.2 


'2.S 


3.5 ■ 



READING FIRST TIME 


2.i 


2.9 


3.2 


2.8 


2.9 


REREADING (text) 


2.1 


2.5 


2.4 


2.S 


2.4 


REREADING (written aids) 


2. 1 


1.3 


l.S 


1.7 


l.S 


UNDERLINING 


2.5 


2.S 


2.9 


2.6 


.2.9 


OUTLINING 


J. / 


.5 


.8 


1.3 


1.3 


SUMMARIZING 


1.3 


.6 


.S 


/.'5' 


1.6 


TERMS, NAMES, DEFINI- 
TIONS 


1.2 


1.3 


1.2 


J. 5 


2.5 


SELF-QUIZZING (si lent, 
text) 


1.7 


J. 2 


1.2 


1.3 


2.8 


SELF-QUIZZING_(si lent, 
written aids) 


1.3 


.9 


.S 


1.2 


1.6 
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Even nx)re intriguing are the data from Experiment I. The averaged per- 
formance of these students was poorer than even that of the Low criter- 
ia phase in Experiment II; however, they studied considerably more than 
the other students "under any criteria level, especially the Low criter- 
ia. Furthermore, they spent proportionately more time outlining, sum- 
marizing, writing down terms, and quizzing themselves than the students 
did under the High criteria in Experiment II. Their good study tactics 
in conjunction with their poor performance suggest the possibility that 
minimum performance criteria may have some effects on academic perfc^rm- 
ance in ways other than through their effects on study habits. 



Therapeutic Teaching 

Probably the most exciting use of the SRF is ,for the strictly practical 
use of providing a precise means of engaging in therapeutic teaching for 
those students who are having performance problems in a course. Thera- 
peutic teaching is the precise and individualized instruction of a stu- 
dent who (^performing at less than his maximum by diagnosing, the causes 
of the inadequate performance and bringing about the changes necessary 
to produce improved performance. While such features of these teaching 
techniques as continuous recording, direct recording, and individualized 
-performances are at least prerequisites to therapeutic teaching, equally 
precise information regarding the study behaviors (which in great part 
produce the performance) is an absolute must, 

A useful way of viewing the SRF data for a problem student throughout 
the quarter is to maintain a graphic profile c^f all performance and SRF 
data on a single easily read sheet. Figure 10 is an* example of such a 
profile. 

This is some of the data of a. 38-year-old man who took the course in ab- 
normal psychology in Winter Quarter, 197K Beyond any problems he had 
with study tactics, he was in the midst of getting ^ divorce and was 
temporarily living with his parents. Although we were not making any 
organized and consistent therapeutic Interventions at the time of this 
project, his profile shows quite clearly the kind of information the 
SRF can provide in this format. By the completion of Unit II, both the 
problem and at least some of the solutions were already evident. He " 
was studying too little overall, particularly on second and sutsequent 
attempts on a unit. He was spending too little time rereading the text 
(note the increase on Unit II and the improved performance) and no time 
reading supplementary materials. In addition, he was not using tech- 
niques of known effectiveness such as outlining, writing down terms and 
definitions, and quizzing himself on. the material. These early conclu- 
sions were borne out in the last two or three units where marked changes 
occurred in most of these behaviors along with improved performance. In 
these later units one may observe increases in study time on second at- 
tempts, in rereading the text, in reading supplementary material, and in 
outlining the material. The availability of such a precise and complete 
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Fig. 10. Individual student performance 
and SRF prof i le. 



record of academic performance and study behaviors for Individual stu- 
dents showing poor performance In a course makes the early detection 
and amelioration of academic problems a relatively easy and precise 
task. 

In summary, the SRF seems to hold profitable potential for, providing 
extens Ive and accurate information about the study behaviors of the 
individual student for use in: 

(1) any research project investigating 
teaching and performance; 

(2) ^ evaluating the effects of teachers • 

♦■hemsel ves ; 

(3) evaluating the effects of curricula 
on students ; 

(^) evaluating teaching methods; and - 

(5) therapeutically instructing students 
who have performance problems* 
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A MULTIPLE BASELINE 
ACHIEVEMENT TEST 

L keith miller 
f. hal weaver 

More and wore university teachers are turning to the use of personal- 
ized , J nstruction (Keller, I968) and other behavior modification methods. 
These methods have in common that they specify the target behavior for 
,the student; develop textual rpaterial utilizing the principles of fad- 
ing, shaping, and stimulus discrimination; and program a variety of 
consequences capable of , mai hta i ni ng desired student behavior. The in- 
troduction of teaching methods based on behavioral research to the 
university classroom is certainly a gratifying development. 

However, we have in" front of us a major challenge: can we utilize our 
rigorous experim'enta 1 methodolpg ' to evaluate— and hopefully, therefore, 
improve— the effectiveness of these teaching procedures? In spite of 
the gi eat amount of work that manv ^sk i 1 led behavior modifiers have put 
into this area, there exist surprfiy|igly few* experimental evaluations* 
To date, there are only statistical exoeriments in the literature com- 
paring the final test scores of students enrolled in behavior modifica- 
tion sections with the test scores of students enrolled in traditional 
sections^ (Born et al., 1972; McMichael and Corey, 1969; SHeppard and 
MacDermot, 1970). These studies report higher test scores in the be- 
havior modification sections than In the traditional sections. 

The present paper reports the evaluation of a teacher-paced personalized 
instruction .course by what oiight be called a multiple 'baseline achieve- 
ment test. This procedure had three features. First, a comprehensive 
achievement test was administered to every student each of the \k weeks 
of the semester. No feedback was given and no contingencies were placed 
on performance. Second, the test was constructed. so that it had five- 
subsections, each one covering ^ne of the five major content units of 
the course. Each subsection was scored separately and these scores were 
ured to define five separate behavioral baselines that might be affected 
by the experimental treatment. Third, the treatment for earh baseline 
consisted of the implementation of -the teaching package foi^the course 
unit corresponding to' the content measured by that subsection of the 
achievement test. 

Figure 1 shows the experimental design that this leads to. The dotted 
lines indicate measurements of achievement in subsections t^rior to the 
introduction of the teaching package--that is, the dotted -line indicates 
baseline measures. For example, prior to the first week we measured 
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EXPERIMEimL DESIGN 



SUBSECTION C ONDITIONS 
▼ ▼ 



♦ RESEARCH METHODS /TR PT PT PT PT 

♦REINFORCEMENT - /TR PT PT PT 

♦STIMULUS CONTROL /TR PT PT 

♦CONDITIONED REINFORCEMENT /TR PT 

♦AVERS I VE CONTROL ' /TR 

H 

KEY: — — baseline 
TR treatment 
PT pos t- 1 rea tmen t 

Fig. I. . 



achievement in each of the five subsections. Next, we introduced the 
teaching package on the Research Methods part of the course. Thus, we 
have a measure of achievement after treatment on that subsection of the 
test (indicated by the TR after the slashed line); at the same time we 
continued to measure the achievement. on the four untreated subsections. 
Thus, they remain in a baseline condition (as indicated by the continu- 
ation of the dotted lines)* After about three weeks of Research Methods, 
we moved on to the unit covering Reinforcement. We then measured acnieve 
ment on the Reinforcement subsection after treatment (as indicated by the 
slashed line and the letters TR) . At the same time, we obtained a post- 
treatment measure on the Research Methods subsection as indicated by 
the letters PT; and we continued to gather baseline measures on the re- 
maining three subsections that have not yet beep taught. As these other 
units were taught we switched each subsection from a baseline to a 
treatment and then post-treatment condition. Thus, the teaching treat- 
ment is introduced sequentially to each of the subsections at approxi- 
mately three week intervals. The result is a multiple baseline achieve- 
ment test for the course. 



This design was used to evaluate the achievement of 23 students enrolled 
in two sections of an introductory behavior modification course. The 
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basic structure of the course might be described as a teacher paced 
personalized Instruction course* The main contingency In the course 
was that students had to pass a dally qU'Iz by answering 90% of the Items 
correctly. If they did not pass the quiz they were required to take a 
make-up test until they did attain a 30% score* Their course grade was 
determined exclusively by the average grade on the Initial quizzes. 

The achievement test had five subsections, each containing ten flll-in- 
the-blank Items. None of the Items appeared on the quizzes. The test 
covered the basic principles that one'mlght find in an I nt rod uctory 'be- 
havior modification course. The validity of the Items was checked by 
administering the test to a. sampte^of advanced graduate students* They 
scored an average of 89% with a range from 82% to 98%. 

First, I am going to present the results of the achievement test In the 
traditional way. Figure 2 shows the before and after scores of the 23 
students on the achievement test. Notice that on the average they scored 

• * » 

100^ 




BEFORE AFTER 



Fig. 2, Achievement score before and after intro- 
duction of the teaching package* 

30% on the achievement test before taking the course. And, after they 
completed the course they scored an average of 85% correct* This Is 
certainly evidence of a substantial increase in their ability to cor- 
rectly answer questions about the basic principles of behavior modifica 
tlon. 



However, the question may still be asked whether their scores increased 
due to their exposure to the course. It might be argued that they had 
been exposed to this material in other courses in which they were en- 
rolled. Or, it may be that they had read the course material, which 
was available to them throughout the semester, on their own. Or, it 
may even be that they became familiar with the test items and learned ^ 
to answer them correctly from sheer familiarity. In short, before and 
after achievement tests do not demonstrate that any increase in achieve- 
ment was clearly associated wi th' the- instructional methodology. 

So, let me go back and present our achievement test results as a mul- 
tiple baseline test. Figure 3 shows the results of the average score 
of each student on each of the subsections of the test plotted for 
each of the 14 presentations of the test. As you can see, the scores 
for each subsection range from a low'of 11% correct for the Avers ive 
Control subsection, to a high of 36% on the Reinforcement subsection at 
the time of the initial test. The average of all subsections on this 
before part of the test v/as 30%. 

After the initia.l test, we assigned material on Methods of Research and 
started ajJmi ni ster i ng daily quizzes on the material. The average score, 
during the next three weeks promptly jumped to 90% on the Methods sub- . 
section while remaining approximately stable on the other four subsec- 
tions. 

We next assigned materials on Reinforcement and started administering 
daily quizzes covering th^at material. The average score on the Rein- 
forcement subsection jumped to over 80%. Meanwhile, the gain on the 
Methods subsection was retained; and the low scores on the other three 
sections held with some slight upward trend in the Conditioned Reinforce- 
ment sijbsection. 

Next, we introduced the teaching package to the Stimulus Control subsec- 
tion and the average score rose to over 80%. At the same time, the gains 
on the other sections held and again there was some slight upward drift 
evident in the Conditioned Reinforcement section. 

Finally, we introduced the teach i ng package to the Conditioned Reinforce- 
ment section and next, to the Avers ive Control section. Scores on both 
subsections increased, although the gain for the Aversive Control sec^ 
tion was less dramatic than we have observed for the other sections. 
At the same time the gains registered on each of the baselines were re- 
tained. 

And, as you already know, the final administration of the achievement 
test resulted ?n an average score of 85%, ranging from a low of 59% for 
the Aversive Control section to a high of 89^ for the Methods of Re- 
search section. 
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• Fig. 3. Average scores on each subsection of the achievement test. 
Dotted line indicates introduction of teaching package for that sub- 
section. 



The multiple baseline achJevement test clearly demonstrates that the 
increases in achievement for each subsection were closely correlated 
with the introduction of the daily quizzes and the grade consequences 
paired with them. -It seems reasonable to conclude from such data that 
the gains in the achievement test were produced by the teaching package 
and not by study in. other courses, self-directed reading of the mater- 
ial, or item familiarity. While this method did not permit us to break 
apart the teaching package and specify the relative importance of the 
quizzes, re- test requirement, or grade back-up, it clearly pointed to 
the effectiveness of the package. 

What we have then is an addition to our measurement and design technolo- 
gy. The multiple baseline achievement test permits us to evaluate the^ 
effectiveness of the, teaching package. It permits us to estimate the 
effect of other influences on student behavior such as item familiarity, 
other courses and free reading. It permits, an assessment^^of the reten- 
tion of material over a moder^ate period of time. And, it permits us to 
spot parts of the course that do not work as well as others — in this 
case the material on Aversive Control did not produce very high -test 
res u 1 1 s . 

One further advantage of the design^ is that it gives us a technology 
for easily and continually evaluating the effectiveness of our teaching 
methodology without disrupting the course or losing time from productive 
teaching." 

Let me close with the hope that this and other experimei>tal methods such 
as we have, seen ^today will be used to evaluate the different components 
of personalized instruction. Let^us remember what hap*pened to the pro- 
grammed instruction movement as it floundered on the shoals of faith 
unaccompanied by hard nosed experimental evaluations. 
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The effect of 
two test -retest procedures 
on the classroom performance 
of undergraduate college students 

darrel le. hostow 
gerald / blumenfeld 

The present paper deals with the classroom behavior "of 
undergraduate college students* Three studies are dis- 
cussed. The first two provide evidence that deferring 
the credit students earn on course quizzes both In- 
. creased the I i ke I ihood that students chose to take ad- 
vantage of weekly remedial exams and increased the,,qual- 
ity of their subsequent performance on a final exam. 
Detai Is of the point system used to defer exam credTt 
and a system for employing students in the scoring of 
their own exams are presented* 



Recent experimental reports have presented several novel instructional 
techniques applicable to college courses (Kel ler , 1968; Ferster, 1968; 
Malott and Svinicki> 1969; McMichael and Corey, 1969; Sheppard and 
MacDermot, 1970; and Cooper and Greiner, 1971). Several of these stud- 
ies have shown that more careful arrangement of reinforcement contin- 
gencies produces measurable differences in the performance of students 
when compared with more traditional college instructional techniques. 
The present research program was conducted to determine whether defer- 
ring credit for students who performed inadequately on the initial quiz 
of any given week in the course would both increase the likelihood that 
they would take a weekly remedial quiz and subsequently perform better 
on a comprehensive final exam in the course. 

In the first experiment a large undergraduate course in introductory 
educational psychology provided 300 subjects* Content material in this 
and all subsequent courses discussed In this paper related primarily to 
elementary learning principles and thejr application In educational and 
home settings. Figure 1 presents the weekly format used in the courses. 
Many of the aspects of this method of Instruction, were developed by ^ 
Dr. Jack Michael at Western Michigan University. As shown on tffeMteft 
side of the figure, all students received their first quiz of the week - 
on Monday. Prior to each Monday, a set of specific behavioral objec- 
tives was handed out to the students describing in detail how they 
should prepare for the Monday quiz. A brief discussion period was car- 
ried on during the first few minutes of class to clarify problems in 
reading assignments. Immediately following the djscussion period^ all 
students took the quiz. As shown in the center of Figure 1, all 
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WEEKLY ACTIVITY SCHEDULE 



Monday 



Wednesday 



Friday 



Inrtia! 
Quiz 



Raturn Quizzes 
& 

Lecture-discussion 



Remedial 
Quiz 



Fig* L General weekly course format. 



students returned to class on Wednesday and the graded quizzes were 
handed out for their inspection. During this time» the instructor 
clarified issues raised by the quiz and presented material which was 
not available to students in written form. Specific questions related 
to the quiz" or general subject matter were first solicited from the 
students who had earned an A on the quiz. When questions from these 
students had been answered and new behavioral objectives for the fol- 
lowing week were handed out, the ''4'' students were allowed to turn in 
their quizzes and leave. ''.4" students were excused from the Friday 
class. The remaining time in the Wednesday class was devoted to a re- 
medial lecture * discussion aimed specifically at those students who 
remained in class because they had not earned an A on the first quiz of 
the week. The experimental programs discussed in the rest of this pa- 
per employed the present weekly activity schedule or a variation of it. 



<^ EXPERIMENT I <^ 



The fFrst of the present research programs was designed to evaluate a 
system of deferring credit earned on the first quiz of the week when 
a student performed poorly. The rationale behind deferring credit be- 
ing that it would encourage the student to restudy the assignment in 
order to perform better on- the remedial quiz. For comparison purposes 
a large 300 student section of an undergraduate educational psychology 
Glass at Southern Illinois University was divided into'two groups which 
experienced two 'testing, cond 1 1 ions alternately. 'The exper imental ques- 
tion which the first experiment set out to answer was: "Jf students 
perform poorly on a weekly. quiz, does withholding course credit until 
they retake another quiz over the course material,, make It more likely 
that they will return for the quiz than if credit was NOT deferred?" 
In other words, does delaying credit make students more likely to take 
the remedfaLnquiz?. » , ' 

The weekly activity schedule In this first experiment was a slight var'i-. 
atlon from the general format outlined in Figure 1. In this schedule 
the course met four times each week. As shown on the left side of 
Figure 2, a lecture was'given on each Monday. On Tuesday, the initial 
quiz of the week was given. ^ For experimental comparison, half of fhe 
students In the course operated under one point condition, while the 
other half experienced a second point condition. We wi 1 1 call one of 
the point conditions the DEFERRED POINT SYSTEM. The left center por- 
tion of Figure 2 shows the system used for deferring credit. If a stu- 
dent operating under the deferred credit system earned a raw score cf 
16 to a maximum of 20 on the quiz, he was given k class points toward 
his final course grade. If he earned anywhere from 11 to 15 raw points 
on his quiz he received only i class point. .If he earned -10 or less, 
he received no credit. As no more- than k class points could be earned 
by a student in any given week, students coming to class on Wednesday 
and finding that they had earned maximum credit *cou Id not benefit from- 
taking the remedial quiz on Friday. However, a student who earned a 
raw score of 15 or less on the initial quiz received so lltMe credit 
for this performance that he needed to earn more points on the remedial 
quiz, or risk flunking the course. Class points in the course were^ 
cumulative; that is, the class points the student earned on each quU 
were totaled at the end of the qour'se in order to determine his letter 
grade. Thus, students performing poorly on an initial quiz were en- . 
couraged to take the remedial quiz or risk a bad ♦letter grade at the end 
of the course. 

As mentioned previously, half of the students experienced the DEFERRED 
POINT SYSTEM, while the other half of the students operated" under a more 
conventional credit system. This system was termed -the RAW SCORE SYSTEM 
because students, when operating under this condition, kept the raw 
score they earned on the initial quiz of the week". However, if a stu-^ 
dent were not satisfied with the raw score he earned on the Initial quiz, 
he could elect to take the remedial quiz and replace his earlier raw 
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WEEKLY ACTIVITY SCHEDULE 
Experiment #1 



Monday 



Lecture 



Tuesday Wednesday 



Deferred Point 
System 



raw score 
16-20 
IMS 
10 or less 



class pts. 
4 
1 
0 



Raw Score 
System 

raw score 1*20 

Initial 
Quiz 



Return ^ 
Quizzes 
& 

Lecture* 
Discussion 



Friday 



Deferred Point 
System 



raw score 
17-20 
14-16 
13 or less 



class pts. 
3 
1 
0 



Raw Score 
System 

raw score 1 -20 

Remedial 
Quiz 



ig* 2, Weekly course format for Experiment 



score If his remedial score was higher. The basic difference between 
the DEFERRED POINT SYSTEM and the RAW POINT- SYSTEM was that a student 
in the RAW POINT SYSTEM could retain a mediocre score on the Initial 
quiz and elect not take the remedial quiz. Whije, on the other hand, 
a student In the DcFERRED POINT SYSTEM lost a great deal of course 
credit If he performed poorly on an Initial quiz and then neglected to 
take, the remedial quiz. 

The students serving as subjects for this experiment were randomly as- 
signed to two grour.*-. Throughout the experiment each group of students 
alternated between the DEFERRED POINT SYSTEM and the RAW POINT SYSTEM. 
In other words, each student, regardless of what group he was placed In, 
experienced both of the point systems. Figure 3 shows the experimental 
design. Notice by looking to the left side of the figure that Group A , 



EXPERIMENTAL DESIGN 



DEFERRED 

POINT 

CONDITION 



ABAB 
BABA 

Week$1&2 Week$3&4 Week$5&6 Week$7&8 



Group A 



Group B Group A 



Group B 



RAW 

POINT 

CONDITION 



Group B 



Group A 



Group B 



Group A 



Fig. 3. Basic design for. Experiment I. 



experienced the DEFERRED POINT CONDITION during weeks 1 and 2, whije 
at the same time Group B experienced the RAW POINT CONDITION. However, 
during weeks 3 and k each group was shifted to the opposite condition. 
During weeks 5 and 6, the groups were shifted again and so on.. Shift- 
ing each group back and forth between the two point conditions allowed 
for both between-group and between-cond i t i ons comparisons, and circum- 
vented student discontent resulting from staying in one experimental 
condition for the whole academic quarter. Figure k shows the system 
for equating, credit earned during each experimental condition. The sys- 
tem was devised so that final letter grades could be given at the end 
of the course. 
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Total Points Accumulated* 

(CLASS POINTS (x5) plus raw 
^ore points) 

155-180 
135-154 
115-134 
35-114 
below 95 



Letter Grade 



A 
B 
C 
D 



*180 was the maximum number of points possible 
and could be earned by a student taking nine 
weekly exams and earning the full 20 points on 
each quiz. Quiz performance data used in this 
study were taken from the first 8 weekly quizzes 
which allowed for four two-week experimental 
conditions. 
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Fig, 4, System for equating credit earne<l by 
individuals in Experiment i. 



Resu Its 



Figure 5 shows results obtained during the academic quarter. In both 
weeks 1 and 2 a higher percentage of students in the group opere*-ing 
under the DEFERRED POINT SYSTEM returned to take the remedial exam* 
During the second two weeks, when the two groups were shifted to the > 
opposite conditions, the same effect was observed. During weeks 3 and 

both groups were shifted to the opposite point conditions. Thus, 
now a higher proportion of Group B students came back to take the reme- 
dial exam; these students were operating under the DEFERRED POINT SYS- 
TEM. During the fifth and sixth weeks when both groups were shifted 
back to the original point system, a higher p.-oportion of Group A 
elected to take the remedial quiz. This approximated the effect ob- 
served during the first two weeks of the course. Shifting the groups 
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QUIZ NUMBER 



F^g* 5* Percent of students who elected to take the 
remedial quiz in Experiment L 



for the final time replicated the effect observed in the second two 
weeks* Results from the first experimental group evaluating the ef- 
fect of deferring credit on the likelihood of students coming back 
for the remedial quiz, suggest that deferring credit do^g^ cause stu- 
dents to at least take the remedial quiz* 



EXPERIMENT 11' 

While results from Experiment I suggested that delaying course credit 
causes a larger precentage of students to take remedial quizzes, a sec 
ond and more important question is whether forced remedial examination 



also affects quiz performance. To answer this question a second experi- 
mental program was conducted at the University of South Florida. 

Figure 6 shows the weekly activity schedule in the second experimental 
program. This schedule was slightly altered from the one employed in 
Experiment I. In this second experimental program the introductory 
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Group A 



Group B 



WEEKLY ACTIVITY SCHEDULE 
Experiment #2 



Monday Wednesday 



Friday 



Deferred Point 
System 

raw score class pts. 

27-30 10 

21-26 2 

18*20 0 



b«low18 

Raw Point 
System 

raw score 1-30 



•1 



Deferred Point 
System 



Return 
Quizzes 
& 

Lecture* 
Discussion ^® 



raw score class pts 

27-30 C 

21-26 6 

18-20 '4 



Raw Point 
System 

raw score 1'30 



Tig. 6. Weekly activity schedule in Experiment Ik 



class in educational psychology met three days a week rather than four. 
Weekly quizzes in this course were expanded to 30 items incorporating 
both short answer essay and multiple choice quiz items. The criterion 
for k performance was raised to 90%. Also, a larger percentage of 
credit was deferred to the remedial quiz when a student performed poorly 
on the Initial weekly quiz. The RAW POINT SYSTEM remained essentially 
the same as in the first experiment. 



The experimental design In this second program was also different. The 
class used as subjects in this study contained 5^ students; The stu- 
dents were randomly placed Into two groups prior to the beginning of' 
the academic quarter. One group of students operated under the DEFERRED 
POINT SYSTEM throughout the entire academic quarter. The other group 
operated under the RAW POINT SYSTEM for the entire quarter. Both groups 
operated under their respective point systems and then at the endLof^fhe 
course both took the final exam at the same time. Quizzes were identi- 
cal for both groups throughout the quarter. The final exam contained 
60 multiple choice Items with an equal number of Items being selected 
from each weekly unit of content material. 



Results 

Data obtained In Experiment I showed that deferring course credit until 
the remedial exam Increased the likelihood that a student would return 
for the remedial quiz. Figure 7 reveals that the same effect was ob- 
served In Experiment II. Data points In Figure 7 represent the percent- 
age of students who came back to take the remedial quiz when they had 
earned less than an A on the Initial quiz. 

Figure 8 shows quiz averages for both groups on the initial quiz of each 
week. The average of test scores of students In the RAW POINT SYSTEM , 
was higher than that achieved by the deferred credit group only In the 
first week of the academic quarter. On all subsequent initial quizzes 
in ttie course, the deferred group performed better. Whi>e more research 
seems necessary to clarify this effect, data in Figure 8 suggest that 
cumulative failure may have been occurring in the group of students who 
were less likely to make use of the remedial quiz each week. 

As mentioned previously, all students received a 60 Item final at the 
end of 'f1ie course. Figure 9 presents the frequency distribution of raw 
scores on the final exam, for both experimental groups. The number of 
individuals in the upper distribution, the deferred credit group, was 
slightly smaller than the number In the second group. While students 
were randomly placed Into the two experimental groups prior to the be- 
ginning of the academic quarter, several students whose names appeared 
on the prereglstratlon class list failed to take the course causing 
slightly uneven experimental groups. 

Figure 9 shows that the distribution of scores from the deferred credi t 
group was slightly higher than those In the raw point group. This ef- 
fect was found to be stat 1st i cal ly significant when the Mann-Whitney 
U-Test was applied to the data (Z = 3-20, p<-01). Results from the 
second experimental program suggest that a system of deferring course 
credit when students performed poorly, thus making them more likely to 
make use of weekly remedial quizzes, served to Increase the quality of 
their academic performance. 



Fig. 7. Percent of 
students i n Experi- 
ment i i scori ng be- 
low an i4 i n each 
experi menta i group 
who elected to take 
the remedial quiz 
each week. 
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Fig. 8. Group quiz averages on the initial quiz of each week 
i n Experiment I L 
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Quiz Grading 



The third part of the present paper deals with the problem of getting 
the quizzes graded in courses similar to those in Experiment I and II. 
The following describes a method for utilizing students from the class 
to aid in the grading of quizzes. This quiz scoring system was de- - 
signed to be incorporated into a DEFERRED CREDIT SYSTEM similar to that 
previously described. The following paragraph-cappeared in, the course 
outline handed out to all students on the first day of class: 

As you might, al ready have guessed, with many quizzes 
being given, there will be a lot of quizzes to grade. 
The. fol lowing grading system has been used previously 
and was found to work quite well. I will grade the 
first two quizzes myself. 'Those students who earn a 
PASS on the first two initial quizzes will be pjaced 
into a pool out of which I will select a number of 
persons to help score quizzes. I will place the 
names of these students on a slip of paper which will 
be made available to students as they hand in their 
quiz papers on the third initial quiz of the course. 
If a student finds his name on this list, he can, if" 
he wishes, help grade quizzes at the scoring session. 
If he elects to help grade, he automatically receives 
a PASS on the quiz he has taken. However, his quiz 
will be scored in the scoring session and I wi 1 1 note 
what each student would have gotten had he not re- 
ceived an automatic PASS. This grading system has a 
number of advantages* No student can reasonably an- 
ticipate that he will be able to score quizzes and re- 
ceive an automatic. PASS as he cannot find out whether 
he is el igible unti 1 after he has already taken the 
quiz. I have found that students who have received, 
at least two ^'earned*' PASSES in a row are usually 
quite able to correctly score other students* re- 
sponses, especially when they have prepared to take 
the quiz themselves. I will announce a number of 
measures calculated to insure grader honesty and re- 
liability when we begin the procedures. Each student 
becomes potentially eligible to be a grader when he 
has earned a. pass on two initial, quizzes in succes- 
sion at any time during the course. 

Three major steps were involved in the selection of graders. Step 1 
was the tabulation of all students who earned /I 'a on the initial quiz 
for two consecutive weeks. Step 2 involved randomly selecting 20 stu- 
dents (from a class of approximately 50 students) from* those who had 
A^s two weeks in a row. These names were placed on a list which was 
made available to each student as he turned in his next following ini- 
tial quiz. If a student found his name on the potential grader list 
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he was asked to place his initials by his name to show up for the grad- 
ing session. Step 3 involved allowing only the first 10 students who 
elected to help grade, to participate in the grading session. The rein- 
forcer for helping grade exams was an AUTOMATIC A on the quiz the stu- 
dent had just taken, no matter how poor his true score on the quiz was. 
Placing 20 names on the list but employing only the first 10 who signed 
up insured that even \f isewera] students declined the opportunity to 
help grade, at least 10 students would show up for the session. Stu- 
dents were informed that once they initialed the list they would receive 
an automatic pass only if they attended the grading session. However, 
if they neglected to attend the session but had signed up to do so, they 
would receive a 0 on the quiz. 

Exam grading was accomplished later on each test day. The instructor 
shuffled and distributed approximately 5 quizzes to each grader. All 
scoring marks were made rn a separate cover sheet and graders placed 
their signatures on the scoring sheet for each of the quizzes they scored. 
Requiring grader signatures on each of the papers allowed for monitoring 
of grader reliability and insured that no grader was allowed to score 
his own quiz. An answer sheet was given to each^grader at the beginning 
of the session. The group of graders scored each quiz item at the same 
time. Only after all graders had completed scoring a given item did the 
instructor signal for going on to the next Item. The instructor circu- 
lated to aid in the interpretation of ambiguous quiz answers. 

This method of selecting graders had several advantages. All graders 
were chosen from those students who had performed well on previous quizzes 
Since the selection of students who were given the opportunity to help 
grade was done on a random basis, no student could predict whether he was 
going to get the opportunity for an automatic ^4 and, therefore, was ad- 
monished to study carefully for. each quiz. A second advantage was that 
the giving of bonus credit was not necessary in order to get students to 
help grade the quizzes. This system allowed a student to *'buy insurance" 
in that when he took the opportunity to help grade quizzes, he was in- 
sured of obtaining an A on the quiz and thus avoided the possibility of 
having to attend a remedial quiz. This appeared to be a reinforcer for 
helping to grad^ quizzes. 

Several steps were taken to evaluate the quality of student quiz grading. 
All student graders were given separate cover sheets for each quiz they 
graded, and were asked to do their scoring on this sheet only. These 
sheets were separated from the quizzes following the grading sessions and 
all quizzes were regraded by a single graduate assistant. In order to 
make a rough comparison of the similarity of scores obtained by student 
graders and the graduate assistant, the grand mean for student graders 
was compared with the grand mean obtained by the graduate assistant in 
each week of the course. Figure 10 shows the grand means obtained. Data 
in this figure suggest a high correspondence between student graderand 
graduate assistant scoring accuracy. 



413 




QUIZ NUMBER 



Fig. 10. Mean quiz score obtained by all student grad- 
ers and mean scores obtained from. the same quizzes'by 
the graduate assistant. 



All students who finished and turned in their quizzes before the total 
of 10 graders had been chosen were asked to inspect the list of poten- 
tial graders. Approximately 3 out of k students who were eligible (by 
having two passes in a row) actually chose to participate in the grad- 
ing sessions. Records were kept concerning how the students who de- 
clined to grade performed on the quizzes and these records were com- 
pared with the scores the graders would have earned had they not elected 
to grade. The mean score on the -uizzes for which students received 
automatic passes was found to be 17-61 (17-00 or above was a pass; 20,00 
was the maximum possible score during the academic quarter of this eval- 
uation). However, the average score for students who had the opportunity, 
but declined to participate in the grading sessions, was 18.84, A t-test 



applied to'Uhese data indicated a statistical ly significant difference 
beyond the .01 level, suggesting that the students who elected to help 
grade exams and receive an automatic i4, tended to be those who were 
more likel^, to benefit from the automatic A* 



Summary 

The preceding programs dealt with the classroom behavior of undergradu- 
ate students and have presented data suggesting that deferring quiz 
credit for poor student performance until the student takes a remedial 
quiz both increases the likelihood that he will take the remedial quiz 
and that he will subsequently perform better on the final exam. Espe- 
cially when combined with the quiz scoring format described above, a 
def . rred credit system appears to have significant educational advan- 
tages. . 
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